Jul 18 01:48:12.487620 ip-10-0-137-80 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 01:48:12.860212 ip-10-0-137-80 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:48:12.860212 ip-10-0-137-80 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 01:48:12.860212 ip-10-0-137-80 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:48:12.860212 ip-10-0-137-80 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 01:48:12.860212 ip-10-0-137-80 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:48:12.861854 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.861117    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866737    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866752    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866756    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866760    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866763    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866766    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866775    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866778    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866782    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866785    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866788    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866791    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866794    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866797    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866800    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866802    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866805    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866808    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866810    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:12.973238 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866813    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:12.930555 ip-10-0-137-80 systemd[1]: Started Kubernetes Kubelet.
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866816    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866819    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866822    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866825    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866827    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866830    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866833    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866836    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866838    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866841    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866844    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866846    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866850    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866852    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866856    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866859    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866861    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866864    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:12.983834 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866867    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866870    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866873    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866876    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866878    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866881    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866883    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866887    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866890    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866893    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866895    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866898    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866900    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866903    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866906    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866908    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866913    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866917    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866921    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866924    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:12.985041 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866926    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866931    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866935    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866938    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866942    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866945    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866949    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866951    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866954    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866957    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866960    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866963    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866966    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866969    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866971    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866974    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866977    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866980    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866983    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866986    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:12.985793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866989    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866992    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866995    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.866997    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867000    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867003    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867006    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867008    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867011    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867013    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867016    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867018    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867021    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867023    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867026    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867030    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867034    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867037    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867040    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:12.986623 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867043    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867046    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867785    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867792    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867796    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867799    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867802    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867805    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867808    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867812    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867815    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867818    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867820    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867823    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867826    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867829    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867831    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867834    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867837    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867839    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:12.987829 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867842    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867844    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867847    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867850    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867852    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867855    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867857    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867861    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867863    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867866    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867869    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867872    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867876    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867878    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867881    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867883    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867886    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867888    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867891    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867893    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:12.988649 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867896    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867899    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867901    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867904    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867907    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867910    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867913    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867915    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867918    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867921    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867924    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867926    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867929    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867932    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867935    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867937    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867940    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867942    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867945    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867948    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:12.989468 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867950    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867953    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867956    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867958    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867961    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867963    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867967    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867973    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867977    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867980    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867983    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867986    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867989    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867992    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867995    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.867998    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868001    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868003    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:12.990255 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868006    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868009    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868012    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868015    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868018    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868021    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868023    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868026    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868028    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868031    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868035    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868038    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868041    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868043    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868046    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868048    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868051    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868054    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868056    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868059    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:12.991090 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868062    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868064    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868067    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868543    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868550    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868553    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868557    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868564    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868567    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868570    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868573    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868576    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868579    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868584    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868587    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868589    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868592    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868595    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868598    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868600    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:12.991837 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868603    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868606    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868609    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868611    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868614    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868617    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868620    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868623    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868626    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868628    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868631    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868634    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868637    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868639    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868642    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868645    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868647    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868650    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868654    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:12.992630 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868658    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868662    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868665    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868668    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868671    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868673    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868678    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868681    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868683    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868686    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868689    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868693    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868696    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868698    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868701    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868703    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868706    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868709    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868711    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868714    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:12.993469 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868716    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868719    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868722    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868724    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868727    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868729    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868732    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868734    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868737    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868739    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868743    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868745    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868748    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868751    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868757    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868760    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868763    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868765    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868770    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868773    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:12.994285 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868776    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868778    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868781    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868783    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868786    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868788    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868791    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868794    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868797    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868799    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868802    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868804    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868807    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868809    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868812    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868818    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868821    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868824    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868827    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:12.995091 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868830    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868833    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868835    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.868838    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868913    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868929    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868952    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868956    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868967    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868971    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868975    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868981    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868984    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868988    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868991    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868994    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.868998    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869001    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869004    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869007    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869010    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869013    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869021    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869024    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 01:48:12.995906 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869028    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869031    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869034    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869038    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869043    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869046    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869050    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869053    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869056    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869059    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869062    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869065    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869069    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869072    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869075    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869078    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869080    2562 flags.go:64] FLAG: --enable-server="true"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869089    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869096    2562 flags.go:64] FLAG: --event-burst="100"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869101    2562 flags.go:64] FLAG: --event-qps="50"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869104    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869107    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869110    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869114    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 01:48:12.996757 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869117    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869120    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869123    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869126    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869129    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869131    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869134    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869137    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869140    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869143    2562 flags.go:64] FLAG: --feature-gates=""
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869146    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869149    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869154    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869157    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869160    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869163    2562 flags.go:64] FLAG: --help="false"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869166    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-137-80.ec2.internal"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869169    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869172    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869175    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869179    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869182    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869185    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 01:48:12.997575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869187    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869190    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869193    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869201    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869206    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869209    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869212    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869215    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869218    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869220    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869223    2562 flags.go:64] FLAG: --lock-file=""
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869226    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869229    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869232    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869238    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869241    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869244    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869247    2562 flags.go:64] FLAG: --logging-format="text"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869250    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869253    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869256    2562 flags.go:64] FLAG: --manifest-url=""
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869260    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869264    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869267    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869271    2562 flags.go:64] FLAG: --max-pods="110"
Jul 18 01:48:12.998782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869274    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869277    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869280    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869283    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869286    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869289    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869292    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869298    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869301    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869304    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869307    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869330    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869339    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869343    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869346    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869349    2562 flags.go:64] FLAG: --port="10250"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869352    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869355    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c3ea1ba16722ded6"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869358    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869362    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869365    2562 flags.go:64] FLAG: --register-node="true"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869368    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869371    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869374    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 18 01:48:12.999591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869377    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869380    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869384    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869387    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869391    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869394    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869397    2562 flags.go:64] FLAG: --runonce="false"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869400    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869403    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869406    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869409    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869412    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869415    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869418    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869421    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869424    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869426    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869429    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869432    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869435    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869446    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869449    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869455    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869457    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869460    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 01:48:13.000424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869466    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869470    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869473    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869476    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869478    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869481    2562 flags.go:64] FLAG: --v="2"
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869485    2562 flags.go:64] FLAG: --version="false"
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869490    2562 flags.go:64] FLAG: --vmodule=""
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869496    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.869513    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869645    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869652    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869655    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869658    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869661    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869665    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869667    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869670    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869673    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869676    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869678    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:13.004079 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869681    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869684    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869686    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869689    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869692    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869694    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869698    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869707    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869710    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869712    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869715    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869718    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869720    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869723    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869725    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869728    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869730    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869733    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869735    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869739    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:13.004872 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869743    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869746    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869750    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869753    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869755    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869758    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869761    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869764    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869766    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869770    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869774    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869776    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869779    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869782    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869785    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869788    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869790    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869793    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869797    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869800    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:13.109198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869803    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869806    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869808    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869811    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869813    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869816    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869819    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869821    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869824    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869826    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869829    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869832    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869834    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869837    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869841    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869843    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869846    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869848    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869851    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869853    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:13.110632 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869856    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869858    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869861    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869864    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869866    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869869    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869872    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869874    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869877    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869880    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869883    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869886    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869888    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869891    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869894    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869897    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869900    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869902    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869905    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869907    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:13.112030 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869910    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869912    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869915    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869917    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869920    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869922    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869926    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.869929    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.870503    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.877572    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.877587    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.877607    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.877613    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877668    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877673    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:13.112986 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877676    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877681    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877685    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877688    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877691    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877694    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877697    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877700    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877703    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877705    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877710    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877713    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877716    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877719    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877722    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877725    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877728    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877731    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877734    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:13.120046 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877737    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877739    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877742    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877745    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877747    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877751    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877755    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877757    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877760    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877763    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877766    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877768    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877771    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877773    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877776    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877779    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877781    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877784    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877787    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:13.121003 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877789    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877795    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877798    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877803    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877805    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877809    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877812    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877815    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877817    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877820    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877823    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877826    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877829    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877832    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877834    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877837    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877840    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877842    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877845    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877847    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:13.122902 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877850    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877852    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877855    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877858    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877862    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877865    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877868    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877871    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877874    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877877    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877879    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877882    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877885    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877889    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877891    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877895    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877898    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877900    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877903    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:13.123849 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877906    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877909    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877911    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877914    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877917    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877920    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877922    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877925    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877927    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877930    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877932    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877935    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877937    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877940    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877942    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877945    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877948    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877950    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877953    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:13.125272 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.877955    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.877960    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878073    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878077    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878080    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878083    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878086    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878090    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878093    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878096    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878100    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878102    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878105    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878109    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:48:13.247561 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878114    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878117    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878121    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878124    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878127    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878130    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878133    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878136    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878139    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878141    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878145    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878148    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878151    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878153    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878156    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878158    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878161    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878164    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878168    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:48:13.248499 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878170    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878177    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878179    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878182    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878184    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878187    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878190    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878193    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878196    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878199    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878202    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878204    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878206    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878210    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878212    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878215    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878217    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878220    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878223    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878225    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:48:13.249436 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878228    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878231    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878233    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878236    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878238    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878241    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878244    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878246    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878249    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878251    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878254    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878256    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878269    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878272    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878276    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878279    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878281    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878284    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878288    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878291    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:48:13.251793 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878293    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878297    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878300    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878302    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878305    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878308    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878310    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878313    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878316    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878334    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878338    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878342    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878345    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878348    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878351    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878353    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878356    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878359    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878361    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878364    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:48:13.252753 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878367    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878369    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878372    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878375    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878377    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878380    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878383    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:12.878386    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.878391    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.878510    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.880570    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.881914    2562 server.go:1019] "Starting client certificate rotation"
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.882010    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:48:13.253702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.882088    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.885435    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.894344    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.902482    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.904479    2562 log.go:25] "Validated CRI v1 image API"
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.905305    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.907439    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.907795    2562 fs.go:135] Filesystem UUIDs: map[6728a93a-9c72-4ba5-8e8c-c08131588d07:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8f0c2cd4-65d3-4bba-a3ef-99af8ce7a4a4:/dev/nvme0n1p4]
Jul 18 01:48:13.257001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.907812    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.912783    2562 manager.go:216] Machine: {Timestamp:2026-07-18 01:48:12.911561887 +0000 UTC m=+0.310961536 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098904 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25dfc508c7a06d970c2a2e2603f7fc SystemUUID:ec25dfc5-08c7-a06d-970c-2a2e2603f7fc BootID:9a7391fd-beb4-41b7-ad08-1b2a472e6467 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:40:4b:cb:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:40:4b:cb:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:c8:bd:74:b8:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.912890    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.913007    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.915988    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.916020    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.916609    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.916619    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.916627    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.917188    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.918284    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921006    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921125    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921152    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921162    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921177    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921187    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921195    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 01:48:13.259879 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921562    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.921579    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.923507    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.924840    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.924868    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925530    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925553    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925568    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925581    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925599    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925614    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925632    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925643    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925654    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925660    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925668    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.925673    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.926278    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.926288    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.929574    2562 server.go:1268] "Started kubelet"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.929789    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.929810    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-82rhc"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.929845    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.930206    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.936025    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:12.936085    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:12.936088    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.936270    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.937053    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-82rhc"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.937152    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:12.937444    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.943887    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.943892    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:12.943962    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.944539    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.944607    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.944606    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.944692    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.944700    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.944823    2562 factory.go:55] Registering systemd factory
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.944838    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.945036    2562 factory.go:153] Registering CRI-O factory
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.945052    2562 factory.go:223] Registration of the crio container factory successfully
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.945105    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.945128    2562 factory.go:103] Registering Raw factory
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.945142    2562 manager.go:1196] Started watching for new ooms in manager
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.945589    2562 manager.go:349] Starting recovery of all containers
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.953494    2562 manager.go:354] Recovery completed
Jul 18 01:48:13.260804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.954949    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:13.263668 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:12.957426    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-80.ec2.internal\" not found" node="ip-10-0-137-80.ec2.internal"
Jul 18 01:48:13.263668 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:12.958298    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:13.263668 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.044610    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.263668 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.144962    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.263668 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.245538    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.390765 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.346040    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.520922 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.447022    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.662828 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.547678    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.662828 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.648382    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.807260 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.748823    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.935044 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.849433    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:13.935044 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:13.881694    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 01:48:13.935044 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:13.881894    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 01:48:13.946463 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:13.942175    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 01:43:13 +0000 UTC" deadline="2028-03-03 20:31:02.067455902 +0000 UTC"
Jul 18 01:48:13.946463 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:13.942211    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14274h42m48.125248351s"
Jul 18 01:48:13.951315 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:13.949698    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:14.073520 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.050378    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:14.195099 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.150868    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:14.311471 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.251502    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:14.352081 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.352047    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:14.373216 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.373188    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:14.373370 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.373225    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:14.373370 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.373241    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:14.373885 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.373864    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 01:48:14.373885 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.373875    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:14.374057 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.373879    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 01:48:14.374057 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.373942    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:48:14.374804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.374774    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:14.374915 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.374823    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:14.374915 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.374840    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:14.375297 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.375265    2562 policy_none.go:49] "None policy: Start"
Jul 18 01:48:14.375297 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.375300    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 01:48:14.375451 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.375333    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 01:48:14.376659 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.376639    2562 policy_none.go:47] "Start"
Jul 18 01:48:14.377732 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.377711    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:14.382856 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.382639    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-80.ec2.internal" not found
Jul 18 01:48:14.388763 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.388735    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:14.397959 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.397940    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-80.ec2.internal" not found
Jul 18 01:48:14.416086 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.416066    2562 manager.go:337] "Starting Device Plugin manager"
Jul 18 01:48:14.416160 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.416109    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 01:48:14.416160 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.416123    2562 server.go:87] "Starting device plugin registration server"
Jul 18 01:48:14.416479 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.416464    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 01:48:14.416525 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.416480    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 01:48:14.416612 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.416589    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 01:48:14.416727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.416679    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 01:48:14.416727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.416689    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 01:48:14.417257 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.417238    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 01:48:14.417345 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.417289    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:14.455452 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.455367    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-80.ec2.internal" not found
Jul 18 01:48:14.518334 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.518299    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:48:14.519668 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.519641    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:48:14.519741 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.519687    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:48:14.519741 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.519701    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:48:14.519741 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.519739    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.523212 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.523179    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 01:48:14.524527 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.524511    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 01:48:14.524638 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.524559    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 01:48:14.524638 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.524594    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 01:48:14.524737 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.524637    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 01:48:14.526664 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.526645    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:14.528277 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.528247    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.528375 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.528280    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-80.ec2.internal\": node \"ip-10-0-137-80.ec2.internal\" not found"
Jul 18 01:48:14.628776 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.628740    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal"]
Jul 18 01:48:14.630330 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.630311    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.631273 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.631252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.654181 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.654150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e688f08ca83892d1676ff730eb85794a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal\" (UID: \"e688f08ca83892d1676ff730eb85794a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.654309 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.654196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e688f08ca83892d1676ff730eb85794a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal\" (UID: \"e688f08ca83892d1676ff730eb85794a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.654309 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.654216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b3df1fc75eded3f7d78936d4b1afba9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-80.ec2.internal\" (UID: \"1b3df1fc75eded3f7d78936d4b1afba9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.656269 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.656251    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.660998 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.660983    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.754895 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.754785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e688f08ca83892d1676ff730eb85794a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal\" (UID: \"e688f08ca83892d1676ff730eb85794a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.754895 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.754827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e688f08ca83892d1676ff730eb85794a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal\" (UID: \"e688f08ca83892d1676ff730eb85794a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.754895 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.754847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b3df1fc75eded3f7d78936d4b1afba9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-80.ec2.internal\" (UID: \"1b3df1fc75eded3f7d78936d4b1afba9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.754895 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.754876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b3df1fc75eded3f7d78936d4b1afba9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-80.ec2.internal\" (UID: \"1b3df1fc75eded3f7d78936d4b1afba9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.754895 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.754876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e688f08ca83892d1676ff730eb85794a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal\" (UID: \"e688f08ca83892d1676ff730eb85794a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.754895 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.754896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e688f08ca83892d1676ff730eb85794a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal\" (UID: \"e688f08ca83892d1676ff730eb85794a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.755593 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.755579    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:48:14.758227 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.758213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.759271 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.759254    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:48:14.763133 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.762501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal"
Jul 18 01:48:14.922663 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.922620    2562 apiserver.go:52] "Watching apiserver"
Jul 18 01:48:14.927527 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.927506    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 01:48:14.927913 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.927891    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-czwtk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal","openshift-multus/multus-jbq87","openshift-network-diagnostics/network-check-target-7r5lw","openshift-ovn-kubernetes/ovnkube-node-dm6qp","kube-system/global-pull-secret-syncer-w4ds8","kube-system/konnectivity-agent-knml9","openshift-image-registry/node-ca-6vlch","openshift-multus/multus-additional-cni-plugins-5dxcv","openshift-multus/network-metrics-daemon-wqbsh","openshift-network-operator/iptables-alerter-k948j","kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"]
Jul 18 01:48:14.929407 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.929376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.931144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.931124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.931712 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.931690    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 01:48:14.931712 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.931707    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:14.931865 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.931775    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f4bzj\""
Jul 18 01:48:14.932463 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.932448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:14.932592 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.932567    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:14.933173 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.933148    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 01:48:14.933413 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.933395    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 01:48:14.933478 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.933400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 01:48:14.933650 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.933637    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rj2mt\""
Jul 18 01:48:14.933818 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.933803    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.933869 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.933817    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 01:48:14.935590 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.935568    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:14.935993 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.935814    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:14.936053 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.936012    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 01:48:14.936169 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.936143    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 01:48:14.936276 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.936202    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 01:48:14.936581 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.936553    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jd5g2\""
Jul 18 01:48:14.937727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.937083    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 01:48:14.937727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.937172    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 01:48:14.937727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.937342    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 01:48:14.937727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.937639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:14.939074 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.939055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:14.940590 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.940573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.940985 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.940967    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 01:48:14.941184 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.941165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-stdrl\""
Jul 18 01:48:14.941318 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.941304    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 01:48:14.941919 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.941905    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:14.941976 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:14.941965    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:14.942880 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.942863    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 01:48:14.942969 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.942917    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 01:48:14.942969 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.942926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 01:48:14.943263 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.943243    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:14.943643 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.943621    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tkjhz\""
Jul 18 01:48:14.943962 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.943947    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 01:48:14.944002 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.943971    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gldf4\""
Jul 18 01:48:14.944037 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.944003    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 01:48:14.944949 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.944922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.945056 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.944933    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 01:48:14.945999 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.945977    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 01:48:14.946206 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.946139    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:48:14.946256 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.946208    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lvbch\""
Jul 18 01:48:14.946291 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.946208    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 01:48:14.946291 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.946266    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 01:48:14.946857 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.946842    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hvdg2\""
Jul 18 01:48:14.946948 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.946874    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 01:48:14.947236 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.947221    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 01:48:14.947320 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.947303    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 01:48:14.956412 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.956412 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-cni-bin\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.956611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6-agent-certs\") pod \"konnectivity-agent-knml9\" (UID: \"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6\") " pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:14.956611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-cni-multus\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.956611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-multus-certs\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.956611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-registration-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.956611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-systemd-units\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.956611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-slash\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-ovnkube-script-lib\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-cnibin\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-os-release\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/866c3e97-9799-4ba5-9028-ef73eaf3487f-dbus\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-socket-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysconfig\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-kubernetes\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d8d9d5-f280-4c42-aed5-411e051b5691-cni-binary-copy\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-kubelet\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.956927 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2r4\" (UniqueName: \"kubernetes.io/projected/28a93625-af19-433a-bc86-3783cd839f50-kube-api-access-hh2r4\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-device-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.956965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-sys\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-tmp\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-hostroot\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwxzm\" (UniqueName: \"kubernetes.io/projected/69d8d9d5-f280-4c42-aed5-411e051b5691-kube-api-access-lwxzm\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-os-release\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-etc-selinux\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-host\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-etc-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-daemon-config\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysctl-conf\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-tuned\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.957301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-modprobe-d\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-lib-modules\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-systemd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/039935a5-7a09-48b1-9784-5a940be1bc4a-ovn-node-metrics-cert\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-cni-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv84f\" (UniqueName: \"kubernetes.io/projected/c38452c4-ccde-4d4d-8e80-49821f53736e-kube-api-access-sv84f\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6cb1397-abc1-48fb-8859-ec2cab541512-iptables-alerter-script\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-run\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2m8\" (UniqueName: \"kubernetes.io/projected/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-kube-api-access-dn2m8\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-kubelet\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-socket-dir-parent\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-etc-kubernetes\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-sys-fs\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.957755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-var-lib-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwfkd\" (UniqueName: \"kubernetes.io/projected/039935a5-7a09-48b1-9784-5a940be1bc4a-kube-api-access-vwfkd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6cb1397-abc1-48fb-8859-ec2cab541512-host-slash\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-cni-netd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxhrf\" (UniqueName: \"kubernetes.io/projected/df167a9d-85cf-4536-884a-7b0152aaf711-kube-api-access-xxhrf\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957734    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drsjb\" (UniqueName: \"kubernetes.io/projected/f6cb1397-abc1-48fb-8859-ec2cab541512-kube-api-access-drsjb\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-env-overrides\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-cni-bin\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957814    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-cnibin\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-var-lib-kubelet\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-system-cni-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a93625-af19-433a-bc86-3783cd839f50-host\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-log-socket\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-ovnkube-config\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/866c3e97-9799-4ba5-9028-ef73eaf3487f-kubelet-config\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.958221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.957979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-systemd\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-node-log\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-netns\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6-konnectivity-ca\") pod \"konnectivity-agent-knml9\" (UID: \"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6\") " pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-k8s-cni-cncf-io\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-conf-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28a93625-af19-433a-bc86-3783cd839f50-serviceca\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-system-cni-dir\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7bc\" (UniqueName: \"kubernetes.io/projected/4835b2ec-8352-4f0d-86bf-75573f69c465-kube-api-access-sb7bc\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysctl-d\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-run-netns\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.958702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.958276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-ovn\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:14.964301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.964279    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:48:14.996710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.996683    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-vz7zd"]
Jul 18 01:48:14.998498 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:14.998477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.003596 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.003550    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-80.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-137-80.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 18 01:48:15.003933 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.003916    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 01:48:15.004051 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.004000    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j5smt\""
Jul 18 01:48:15.030994 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.030963    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bp6sc"
Jul 18 01:48:15.048144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.048114    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bp6sc"
Jul 18 01:48:15.058950 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.058914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.058950 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.058946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.058967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-modprobe-d\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.058990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-lib-modules\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-systemd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059084    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/039935a5-7a09-48b1-9784-5a940be1bc4a-ovn-node-metrics-cert\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-systemd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-cni-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.059180 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv84f\" (UniqueName: \"kubernetes.io/projected/c38452c4-ccde-4d4d-8e80-49821f53736e-kube-api-access-sv84f\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-modprobe-d\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059192    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-lib-modules\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6cb1397-abc1-48fb-8859-ec2cab541512-iptables-alerter-script\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-run\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2m8\" (UniqueName: \"kubernetes.io/projected/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-kube-api-access-dn2m8\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-cni-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-kubelet\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-socket-dir-parent\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-kubelet\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-etc-kubernetes\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d55b449-511a-4a2c-b30f-335a75a6641c-tmp-dir\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-sys-fs\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-socket-dir-parent\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-etc-kubernetes\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-sys-fs\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-run\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.059768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-var-lib-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059660    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-var-lib-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwfkd\" (UniqueName: \"kubernetes.io/projected/039935a5-7a09-48b1-9784-5a940be1bc4a-kube-api-access-vwfkd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6cb1397-abc1-48fb-8859-ec2cab541512-host-slash\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-cni-netd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxhrf\" (UniqueName: \"kubernetes.io/projected/df167a9d-85cf-4536-884a-7b0152aaf711-kube-api-access-xxhrf\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059920    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f6cb1397-abc1-48fb-8859-ec2cab541512-iptables-alerter-script\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drsjb\" (UniqueName: \"kubernetes.io/projected/f6cb1397-abc1-48fb-8859-ec2cab541512-kube-api-access-drsjb\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6cb1397-abc1-48fb-8859-ec2cab541512-host-slash\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.059980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-env-overrides\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-cni-bin\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-cnibin\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-var-lib-kubelet\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-system-cni-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-cni-netd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a93625-af19-433a-bc86-3783cd839f50-host\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:15.060830 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-log-socket\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060169    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a93625-af19-433a-bc86-3783cd839f50-host\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-ovnkube-config\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/866c3e97-9799-4ba5-9028-ef73eaf3487f-kubelet-config\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d55b449-511a-4a2c-b30f-335a75a6641c-hosts-file\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-log-socket\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-systemd\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-node-log\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-cnibin\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-cni-bin\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-netns\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060491    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-netns\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/866c3e97-9799-4ba5-9028-ef73eaf3487f-kubelet-config\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6-konnectivity-ca\") pod \"konnectivity-agent-knml9\" (UID: \"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6\") " pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-k8s-cni-cncf-io\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-conf-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.061651 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.060592    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-conf-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-k8s-cni-cncf-io\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-env-overrides\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-var-lib-kubelet\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.060712    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs podName:c38452c4-ccde-4d4d-8e80-49821f53736e nodeName:}" failed. No retries permitted until 2026-07-18 01:48:15.560690429 +0000 UTC m=+2.960090091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs") pod "network-metrics-daemon-wqbsh" (UID: "c38452c4-ccde-4d4d-8e80-49821f53736e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-system-cni-dir\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060758    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-node-log\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-systemd\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28a93625-af19-433a-bc86-3783cd839f50-serviceca\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-system-cni-dir\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-ovnkube-config\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.060902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-system-cni-dir\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6-konnectivity-ca\") pod \"konnectivity-agent-knml9\" (UID: \"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6\") " pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:15.062528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061235    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7bc\" (UniqueName: \"kubernetes.io/projected/4835b2ec-8352-4f0d-86bf-75573f69c465-kube-api-access-sb7bc\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28a93625-af19-433a-bc86-3783cd839f50-serviceca\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysctl-d\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-run-netns\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-ovn\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061480    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysctl-d\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061531    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-ovn\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-cni-bin\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-run-netns\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-cni-bin\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6-agent-certs\") pod \"konnectivity-agent-knml9\" (UID: \"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6\") " pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-run-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-cni-multus\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df167a9d-85cf-4536-884a-7b0152aaf711-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.063336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-multus-certs\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-run-multus-certs\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-registration-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-systemd-units\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-slash\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-cni-multus\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061769    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-host-slash\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-registration-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-ovnkube-script-lib\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061739    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-systemd-units\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-cnibin\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-os-release\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/866c3e97-9799-4ba5-9028-ef73eaf3487f-dbus\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-cnibin\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-socket-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysconfig\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-os-release\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064144 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-kubernetes\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d8d9d5-f280-4c42-aed5-411e051b5691-cni-binary-copy\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-kubelet\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.062048    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-socket-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.061954    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/866c3e97-9799-4ba5-9028-ef73eaf3487f-dbus\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.062120    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret podName:866c3e97-9799-4ba5-9028-ef73eaf3487f nodeName:}" failed. No retries permitted until 2026-07-18 01:48:15.562083602 +0000 UTC m=+2.961483245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret") pod "global-pull-secret-syncer-w4ds8" (UID: "866c3e97-9799-4ba5-9028-ef73eaf3487f") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2r4\" (UniqueName: \"kubernetes.io/projected/28a93625-af19-433a-bc86-3783cd839f50-kube-api-access-hh2r4\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-kubernetes\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-device-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-sys\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysconfig\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-tmp\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062232    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-device-dir\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062233    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/039935a5-7a09-48b1-9784-5a940be1bc4a-ovnkube-script-lib\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-hostroot\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062272    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-sys\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.064820 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-hostroot\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwxzm\" (UniqueName: \"kubernetes.io/projected/69d8d9d5-f280-4c42-aed5-411e051b5691-kube-api-access-lwxzm\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xktd\" (UniqueName: \"kubernetes.io/projected/2d55b449-511a-4a2c-b30f-335a75a6641c-kube-api-access-2xktd\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-os-release\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-etc-selinux\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d8d9d5-f280-4c42-aed5-411e051b5691-host-var-lib-kubelet\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-host\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-os-release\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-etc-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062596    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-host\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4835b2ec-8352-4f0d-86bf-75573f69c465-etc-selinux\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/039935a5-7a09-48b1-9784-5a940be1bc4a-etc-openvswitch\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-daemon-config\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysctl-conf\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-tuned\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df167a9d-85cf-4536-884a-7b0152aaf711-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.065338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.062906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-sysctl-conf\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.065858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.063125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d8d9d5-f280-4c42-aed5-411e051b5691-multus-daemon-config\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.065858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.063516    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d8d9d5-f280-4c42-aed5-411e051b5691-cni-binary-copy\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.065858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.064486    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/039935a5-7a09-48b1-9784-5a940be1bc4a-ovn-node-metrics-cert\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.065858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.064594    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6-agent-certs\") pod \"konnectivity-agent-knml9\" (UID: \"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6\") " pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:15.065858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.064638    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-tmp\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.065858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.064780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-etc-tuned\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.083084 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.083045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwfkd\" (UniqueName: \"kubernetes.io/projected/039935a5-7a09-48b1-9784-5a940be1bc4a-kube-api-access-vwfkd\") pod \"ovnkube-node-dm6qp\" (UID: \"039935a5-7a09-48b1-9784-5a940be1bc4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.083084 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.083059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv84f\" (UniqueName: \"kubernetes.io/projected/c38452c4-ccde-4d4d-8e80-49821f53736e-kube-api-access-sv84f\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:15.083084 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.083059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drsjb\" (UniqueName: \"kubernetes.io/projected/f6cb1397-abc1-48fb-8859-ec2cab541512-kube-api-access-drsjb\") pod \"iptables-alerter-k948j\" (UID: \"f6cb1397-abc1-48fb-8859-ec2cab541512\") " pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:15.083451 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.083432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2r4\" (UniqueName: \"kubernetes.io/projected/28a93625-af19-433a-bc86-3783cd839f50-kube-api-access-hh2r4\") pod \"node-ca-6vlch\" (UID: \"28a93625-af19-433a-bc86-3783cd839f50\") " pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:15.086972 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.086950    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:15.087079 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.086982    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:15.087079 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.086997    2562 projected.go:196] Error preparing data for projected volume kube-api-access-gwbfk for pod openshift-network-diagnostics/network-check-target-7r5lw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:15.087165 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.087106    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk podName:e7500b7b-2b78-4449-919a-a2233f57cfea nodeName:}" failed. No retries permitted until 2026-07-18 01:48:15.587083246 +0000 UTC m=+2.986482901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwbfk" (UniqueName: "kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk") pod "network-check-target-7r5lw" (UID: "e7500b7b-2b78-4449-919a-a2233f57cfea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:15.091627 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.091601    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7bc\" (UniqueName: \"kubernetes.io/projected/4835b2ec-8352-4f0d-86bf-75573f69c465-kube-api-access-sb7bc\") pod \"aws-ebs-csi-driver-node-sjbrs\" (UID: \"4835b2ec-8352-4f0d-86bf-75573f69c465\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.098778 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.098750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2m8\" (UniqueName: \"kubernetes.io/projected/c12cfd5d-59ec-46e2-82bf-bc22f32d2fed-kube-api-access-dn2m8\") pod \"tuned-czwtk\" (UID: \"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed\") " pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.098778 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.098763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwxzm\" (UniqueName: \"kubernetes.io/projected/69d8d9d5-f280-4c42-aed5-411e051b5691-kube-api-access-lwxzm\") pod \"multus-jbq87\" (UID: \"69d8d9d5-f280-4c42-aed5-411e051b5691\") " pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.099010 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.098906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxhrf\" (UniqueName: \"kubernetes.io/projected/df167a9d-85cf-4536-884a-7b0152aaf711-kube-api-access-xxhrf\") pod \"multus-additional-cni-plugins-5dxcv\" (UID: \"df167a9d-85cf-4536-884a-7b0152aaf711\") " pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.099479 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.099459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs"
Jul 18 01:48:15.163668 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.163634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d55b449-511a-4a2c-b30f-335a75a6641c-hosts-file\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.163874 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.163765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xktd\" (UniqueName: \"kubernetes.io/projected/2d55b449-511a-4a2c-b30f-335a75a6641c-kube-api-access-2xktd\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.163874 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.163772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2d55b449-511a-4a2c-b30f-335a75a6641c-hosts-file\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.163874 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.163855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d55b449-511a-4a2c-b30f-335a75a6641c-tmp-dir\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.164223 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.164200    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d55b449-511a-4a2c-b30f-335a75a6641c-tmp-dir\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:15.254633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.254600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czwtk"
Jul 18 01:48:15.282031 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.281984    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12cfd5d_59ec_46e2_82bf_bc22f32d2fed.slice/crio-0dbad55c378f0da0b2c3806425ea67295cfec68933f9484efe9e1409899db849 WatchSource:0}: Error finding container 0dbad55c378f0da0b2c3806425ea67295cfec68933f9484efe9e1409899db849: Status 404 returned error can't find the container with id 0dbad55c378f0da0b2c3806425ea67295cfec68933f9484efe9e1409899db849
Jul 18 01:48:15.282883 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.282843    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3df1fc75eded3f7d78936d4b1afba9.slice/crio-80e98f452c54a00fe76118155caf12287e899610b3fa30c3319805ebc8265a19 WatchSource:0}: Error finding container 80e98f452c54a00fe76118155caf12287e899610b3fa30c3319805ebc8265a19: Status 404 returned error can't find the container with id 80e98f452c54a00fe76118155caf12287e899610b3fa30c3319805ebc8265a19
Jul 18 01:48:15.283474 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.283452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbq87"
Jul 18 01:48:15.283864 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.283838    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode688f08ca83892d1676ff730eb85794a.slice/crio-2d07893a4a2a40cca00039210912f9a540b07c6a3da9cc256354fbb7ce144d74 WatchSource:0}: Error finding container 2d07893a4a2a40cca00039210912f9a540b07c6a3da9cc256354fbb7ce144d74: Status 404 returned error can't find the container with id 2d07893a4a2a40cca00039210912f9a540b07c6a3da9cc256354fbb7ce144d74
Jul 18 01:48:15.287637 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.287621    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:48:15.292850 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.292825    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d8d9d5_f280_4c42_aed5_411e051b5691.slice/crio-41230a3a9c71989c5fffa84dcddb0053660f4cb6ff62c1e5bc80b1ce4e1e3702 WatchSource:0}: Error finding container 41230a3a9c71989c5fffa84dcddb0053660f4cb6ff62c1e5bc80b1ce4e1e3702: Status 404 returned error can't find the container with id 41230a3a9c71989c5fffa84dcddb0053660f4cb6ff62c1e5bc80b1ce4e1e3702
Jul 18 01:48:15.300611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.300584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:15.308867 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.308834    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039935a5_7a09_48b1_9784_5a940be1bc4a.slice/crio-b61953ec03ff8589663424e9dd02c36e5682fdfa4515fbaf72f4c2c45160a145 WatchSource:0}: Error finding container b61953ec03ff8589663424e9dd02c36e5682fdfa4515fbaf72f4c2c45160a145: Status 404 returned error can't find the container with id b61953ec03ff8589663424e9dd02c36e5682fdfa4515fbaf72f4c2c45160a145
Jul 18 01:48:15.313835 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.313811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:15.321330 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.321303    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7695c40_95bf_4ba2_a4e5_efe1e67e7ca6.slice/crio-d7132bc62149aa609336d58c1763dddd9bcace0680c1e022d676fafe415194f6 WatchSource:0}: Error finding container d7132bc62149aa609336d58c1763dddd9bcace0680c1e022d676fafe415194f6: Status 404 returned error can't find the container with id d7132bc62149aa609336d58c1763dddd9bcace0680c1e022d676fafe415194f6
Jul 18 01:48:15.339847 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.339817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6vlch"
Jul 18 01:48:15.347631 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.347603    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a93625_af19_433a_bc86_3783cd839f50.slice/crio-f6bc01e428227ec258df35e79ae9ded72fd1a0bbd9c7ffb3aa3dfa19e563d2f1 WatchSource:0}: Error finding container f6bc01e428227ec258df35e79ae9ded72fd1a0bbd9c7ffb3aa3dfa19e563d2f1: Status 404 returned error can't find the container with id f6bc01e428227ec258df35e79ae9ded72fd1a0bbd9c7ffb3aa3dfa19e563d2f1
Jul 18 01:48:15.357579 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.357538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5dxcv"
Jul 18 01:48:15.365459 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.365430    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf167a9d_85cf_4536_884a_7b0152aaf711.slice/crio-bda2518c4469dbf24d01f58ad600fe060a13c9b4f6134d6cff3899a780b5871e WatchSource:0}: Error finding container bda2518c4469dbf24d01f58ad600fe060a13c9b4f6134d6cff3899a780b5871e: Status 404 returned error can't find the container with id bda2518c4469dbf24d01f58ad600fe060a13c9b4f6134d6cff3899a780b5871e
Jul 18 01:48:15.378654 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.378610    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k948j"
Jul 18 01:48:15.386622 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.386591    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cb1397_abc1_48fb_8859_ec2cab541512.slice/crio-d83d91dbfa97be284ccef933861903274713e7bce22a606f004ebb5afc199f55 WatchSource:0}: Error finding container d83d91dbfa97be284ccef933861903274713e7bce22a606f004ebb5afc199f55: Status 404 returned error can't find the container with id d83d91dbfa97be284ccef933861903274713e7bce22a606f004ebb5afc199f55
Jul 18 01:48:15.396560 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.396532    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:48:15.451792 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:15.451758    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4835b2ec_8352_4f0d_86bf_75573f69c465.slice/crio-32739be9e79468a9416e2becf653fa02e4af908720947622d79dd877afba03a4 WatchSource:0}: Error finding container 32739be9e79468a9416e2becf653fa02e4af908720947622d79dd877afba03a4: Status 404 returned error can't find the container with id 32739be9e79468a9416e2becf653fa02e4af908720947622d79dd877afba03a4
Jul 18 01:48:15.529055 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.528933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"b61953ec03ff8589663424e9dd02c36e5682fdfa4515fbaf72f4c2c45160a145"}
Jul 18 01:48:15.530156 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.530129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbq87" event={"ID":"69d8d9d5-f280-4c42-aed5-411e051b5691","Type":"ContainerStarted","Data":"41230a3a9c71989c5fffa84dcddb0053660f4cb6ff62c1e5bc80b1ce4e1e3702"}
Jul 18 01:48:15.531260 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.531222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czwtk" event={"ID":"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed","Type":"ContainerStarted","Data":"0dbad55c378f0da0b2c3806425ea67295cfec68933f9484efe9e1409899db849"}
Jul 18 01:48:15.532225 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.532201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal" event={"ID":"1b3df1fc75eded3f7d78936d4b1afba9","Type":"ContainerStarted","Data":"80e98f452c54a00fe76118155caf12287e899610b3fa30c3319805ebc8265a19"}
Jul 18 01:48:15.533272 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.533250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal" event={"ID":"e688f08ca83892d1676ff730eb85794a","Type":"ContainerStarted","Data":"2d07893a4a2a40cca00039210912f9a540b07c6a3da9cc256354fbb7ce144d74"}
Jul 18 01:48:15.534314 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.534295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs" event={"ID":"4835b2ec-8352-4f0d-86bf-75573f69c465","Type":"ContainerStarted","Data":"32739be9e79468a9416e2becf653fa02e4af908720947622d79dd877afba03a4"}
Jul 18 01:48:15.535336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.535302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k948j" event={"ID":"f6cb1397-abc1-48fb-8859-ec2cab541512","Type":"ContainerStarted","Data":"d83d91dbfa97be284ccef933861903274713e7bce22a606f004ebb5afc199f55"}
Jul 18 01:48:15.536270 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.536254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerStarted","Data":"bda2518c4469dbf24d01f58ad600fe060a13c9b4f6134d6cff3899a780b5871e"}
Jul 18 01:48:15.537300 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.537279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6vlch" event={"ID":"28a93625-af19-433a-bc86-3783cd839f50","Type":"ContainerStarted","Data":"f6bc01e428227ec258df35e79ae9ded72fd1a0bbd9c7ffb3aa3dfa19e563d2f1"}
Jul 18 01:48:15.538383 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.538357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-knml9" event={"ID":"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6","Type":"ContainerStarted","Data":"d7132bc62149aa609336d58c1763dddd9bcace0680c1e022d676fafe415194f6"}
Jul 18 01:48:15.566342 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.566304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:15.566525 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.566377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:15.566525 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.566472    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:15.566525 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.566473    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:15.566626 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.566564    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret podName:866c3e97-9799-4ba5-9028-ef73eaf3487f nodeName:}" failed. No retries permitted until 2026-07-18 01:48:16.566515486 +0000 UTC m=+3.965915123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret") pod "global-pull-secret-syncer-w4ds8" (UID: "866c3e97-9799-4ba5-9028-ef73eaf3487f") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:15.566626 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.566582    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs podName:c38452c4-ccde-4d4d-8e80-49821f53736e nodeName:}" failed. No retries permitted until 2026-07-18 01:48:16.566573498 +0000 UTC m=+3.965973137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs") pod "network-metrics-daemon-wqbsh" (UID: "c38452c4-ccde-4d4d-8e80-49821f53736e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:15.667343 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:15.667306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:15.667541 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.667496    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:15.667541 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.667524    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:15.667541 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.667539    2562 projected.go:196] Error preparing data for projected volume kube-api-access-gwbfk for pod openshift-network-diagnostics/network-check-target-7r5lw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:15.667701 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:15.667617    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk podName:e7500b7b-2b78-4449-919a-a2233f57cfea nodeName:}" failed. No retries permitted until 2026-07-18 01:48:16.667594985 +0000 UTC m=+4.066994639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwbfk" (UniqueName: "kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk") pod "network-check-target-7r5lw" (UID: "e7500b7b-2b78-4449-919a-a2233f57cfea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:16.050772 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.050495    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:43:15 +0000 UTC" deadline="2027-12-13 03:16:55.810761802 +0000 UTC"
Jul 18 01:48:16.050772 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.050565    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12313h28m39.760202112s"
Jul 18 01:48:16.230479 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.230438    2562 projected.go:291] Couldn't get configMap openshift-dns/openshift-service-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 18 01:48:16.230479 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.230479    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2xktd for pod openshift-dns/node-resolver-vz7zd: failed to sync configmap cache: timed out waiting for the condition
Jul 18 01:48:16.230738 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.230563    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d55b449-511a-4a2c-b30f-335a75a6641c-kube-api-access-2xktd podName:2d55b449-511a-4a2c-b30f-335a75a6641c nodeName:}" failed. No retries permitted until 2026-07-18 01:48:16.730538834 +0000 UTC m=+4.129938489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2xktd" (UniqueName: "kubernetes.io/projected/2d55b449-511a-4a2c-b30f-335a75a6641c-kube-api-access-2xktd") pod "node-resolver-vz7zd" (UID: "2d55b449-511a-4a2c-b30f-335a75a6641c") : failed to sync configmap cache: timed out waiting for the condition
Jul 18 01:48:16.320957 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.320845    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 01:48:16.526564 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.526532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:16.526760 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.526682    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:16.526760 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.526532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:16.526882 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.526838    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:16.526944 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.526930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:16.527030 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.527005    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:16.575866 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.575777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:16.576046 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.575883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:16.576046 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.576010    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:16.576164 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.576076    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs podName:c38452c4-ccde-4d4d-8e80-49821f53736e nodeName:}" failed. No retries permitted until 2026-07-18 01:48:18.57605521 +0000 UTC m=+5.975454854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs") pod "network-metrics-daemon-wqbsh" (UID: "c38452c4-ccde-4d4d-8e80-49821f53736e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:16.576533 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.576512    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:16.576644 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.576570    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret podName:866c3e97-9799-4ba5-9028-ef73eaf3487f nodeName:}" failed. No retries permitted until 2026-07-18 01:48:18.576554844 +0000 UTC m=+5.975954489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret") pod "global-pull-secret-syncer-w4ds8" (UID: "866c3e97-9799-4ba5-9028-ef73eaf3487f") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:16.676761 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.676687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:16.676963 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.676943    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:16.677028 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.676969    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:16.677028 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.676984    2562 projected.go:196] Error preparing data for projected volume kube-api-access-gwbfk for pod openshift-network-diagnostics/network-check-target-7r5lw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:16.677138 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:16.677051    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk podName:e7500b7b-2b78-4449-919a-a2233f57cfea nodeName:}" failed. No retries permitted until 2026-07-18 01:48:18.677031122 +0000 UTC m=+6.076430763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwbfk" (UniqueName: "kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk") pod "network-check-target-7r5lw" (UID: "e7500b7b-2b78-4449-919a-a2233f57cfea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:16.777244 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.777187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xktd\" (UniqueName: \"kubernetes.io/projected/2d55b449-511a-4a2c-b30f-335a75a6641c-kube-api-access-2xktd\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:16.798778 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.798749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xktd\" (UniqueName: \"kubernetes.io/projected/2d55b449-511a-4a2c-b30f-335a75a6641c-kube-api-access-2xktd\") pod \"node-resolver-vz7zd\" (UID: \"2d55b449-511a-4a2c-b30f-335a75a6641c\") " pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:16.911229 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:16.911139    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vz7zd"
Jul 18 01:48:16.941592 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:48:16.941554    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d55b449_511a_4a2c_b30f_335a75a6641c.slice/crio-3708e8d41c85d7d6eef0ba77ffeda5411c59f4b33cd26f89ec661a93f0acea88 WatchSource:0}: Error finding container 3708e8d41c85d7d6eef0ba77ffeda5411c59f4b33cd26f89ec661a93f0acea88: Status 404 returned error can't find the container with id 3708e8d41c85d7d6eef0ba77ffeda5411c59f4b33cd26f89ec661a93f0acea88
Jul 18 01:48:17.051369 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:17.051316    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:43:15 +0000 UTC" deadline="2028-03-14 19:05:01.334320867 +0000 UTC"
Jul 18 01:48:17.051369 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:17.051355    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14537h16m44.282971485s"
Jul 18 01:48:17.572709 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:17.572665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vz7zd" event={"ID":"2d55b449-511a-4a2c-b30f-335a75a6641c","Type":"ContainerStarted","Data":"3708e8d41c85d7d6eef0ba77ffeda5411c59f4b33cd26f89ec661a93f0acea88"}
Jul 18 01:48:18.525684 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:18.525645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:18.526173 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.525830    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:18.526173 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:18.526164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:18.526306 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.526286    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:18.526417 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:18.526384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:18.526534 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.526510    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:18.597070 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:18.597029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:18.597252 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:18.597098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:18.597332 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.597258    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:18.597332 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.597325    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret podName:866c3e97-9799-4ba5-9028-ef73eaf3487f nodeName:}" failed. No retries permitted until 2026-07-18 01:48:22.597304641 +0000 UTC m=+9.996704295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret") pod "global-pull-secret-syncer-w4ds8" (UID: "866c3e97-9799-4ba5-9028-ef73eaf3487f") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:18.597787 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.597764    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:18.597901 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.597827    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs podName:c38452c4-ccde-4d4d-8e80-49821f53736e nodeName:}" failed. No retries permitted until 2026-07-18 01:48:22.597811236 +0000 UTC m=+9.997210889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs") pod "network-metrics-daemon-wqbsh" (UID: "c38452c4-ccde-4d4d-8e80-49821f53736e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:18.698391 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:18.698332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:18.698616 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.698581    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:18.698616 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.698601    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:18.698616 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.698615    2562 projected.go:196] Error preparing data for projected volume kube-api-access-gwbfk for pod openshift-network-diagnostics/network-check-target-7r5lw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:18.698799 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:18.698682    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk podName:e7500b7b-2b78-4449-919a-a2233f57cfea nodeName:}" failed. No retries permitted until 2026-07-18 01:48:22.6986599 +0000 UTC m=+10.098059539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwbfk" (UniqueName: "kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk") pod "network-check-target-7r5lw" (UID: "e7500b7b-2b78-4449-919a-a2233f57cfea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:20.525983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:20.525934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:20.526490 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:20.526094    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:20.526566 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:20.526528    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:20.526680 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:20.526657    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:20.526823 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:20.526806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:20.526931 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:20.526909    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:22.526629 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:22.525780    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:22.526629 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.525933    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:22.526629 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:22.526128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:22.526629 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.526267    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:22.526629 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:22.526433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:22.526629 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.526559    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:22.635246 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:22.635203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:22.635471 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:22.635279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:22.635471 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.635420    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:22.635611 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.635502    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs podName:c38452c4-ccde-4d4d-8e80-49821f53736e nodeName:}" failed. No retries permitted until 2026-07-18 01:48:30.63548101 +0000 UTC m=+18.034880653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs") pod "network-metrics-daemon-wqbsh" (UID: "c38452c4-ccde-4d4d-8e80-49821f53736e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:22.635803 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.635420    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:22.635803 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.635778    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret podName:866c3e97-9799-4ba5-9028-ef73eaf3487f nodeName:}" failed. No retries permitted until 2026-07-18 01:48:30.635751911 +0000 UTC m=+18.035151559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret") pod "global-pull-secret-syncer-w4ds8" (UID: "866c3e97-9799-4ba5-9028-ef73eaf3487f") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:22.736188 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:22.736116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:22.736419 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.736284    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:22.736419 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.736313    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:22.736419 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.736327    2562 projected.go:196] Error preparing data for projected volume kube-api-access-gwbfk for pod openshift-network-diagnostics/network-check-target-7r5lw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:22.736419 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:22.736415    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk podName:e7500b7b-2b78-4449-919a-a2233f57cfea nodeName:}" failed. No retries permitted until 2026-07-18 01:48:30.736395296 +0000 UTC m=+18.135794934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwbfk" (UniqueName: "kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk") pod "network-check-target-7r5lw" (UID: "e7500b7b-2b78-4449-919a-a2233f57cfea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:24.526304 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:24.526263    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:24.526857 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:24.526392    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:24.526857 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:24.526430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:24.526857 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:24.526565    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:24.526857 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:24.526564    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:24.526857 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:24.526656    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:26.525559 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:26.525514    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:26.525559 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:26.525543    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:26.526031 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:26.525667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:26.526031 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:26.525675    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:26.526031 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:26.525748    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:26.526031 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:26.525864    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:28.525787 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:28.525742    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:28.526222 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:28.525745    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:28.526222 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:28.525885    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:28.526222 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:28.525954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:28.526222 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:28.525748    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:28.526222 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:28.526058    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:30.525636 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:30.525593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:30.526108 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:30.525601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:30.526108 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:30.525733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:30.526108 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.525732    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:30.526108 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.525850    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:30.526108 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.525954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:30.700497 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:30.700464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:30.700689 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:30.700523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:30.700689 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.700582    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:30.700689 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.700645    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:30.700689 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.700660    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs podName:c38452c4-ccde-4d4d-8e80-49821f53736e nodeName:}" failed. No retries permitted until 2026-07-18 01:48:46.700639072 +0000 UTC m=+34.100038712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs") pod "network-metrics-daemon-wqbsh" (UID: "c38452c4-ccde-4d4d-8e80-49821f53736e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:30.700689 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.700692    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret podName:866c3e97-9799-4ba5-9028-ef73eaf3487f nodeName:}" failed. No retries permitted until 2026-07-18 01:48:46.700678237 +0000 UTC m=+34.100077887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret") pod "global-pull-secret-syncer-w4ds8" (UID: "866c3e97-9799-4ba5-9028-ef73eaf3487f") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:30.801729 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:30.801647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:30.801895 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.801797    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:30.801895 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.801815    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:30.801895 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.801825    2562 projected.go:196] Error preparing data for projected volume kube-api-access-gwbfk for pod openshift-network-diagnostics/network-check-target-7r5lw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:30.801895 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:30.801883    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk podName:e7500b7b-2b78-4449-919a-a2233f57cfea nodeName:}" failed. No retries permitted until 2026-07-18 01:48:46.801865563 +0000 UTC m=+34.201265200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwbfk" (UniqueName: "kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk") pod "network-check-target-7r5lw" (UID: "e7500b7b-2b78-4449-919a-a2233f57cfea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:32.525929 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:32.525733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:32.526374 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:32.525731    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:32.526374 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:32.526000    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:32.526374 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:32.526106    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:32.526374 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:32.525734    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:32.526374 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:32.526205    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:34.529604 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:34.529576    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:34.530029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:34.529665    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:34.530029 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:34.529673    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:34.530029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:34.529702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:34.530029 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:34.529787    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:34.530029 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:34.529869    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:36.535284 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.535062    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:36.536076 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:36.535442    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:36.536307 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.536157    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:36.536307 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:36.536299    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:36.536477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.536391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:36.536530 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:36.536509    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:36.618487 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.618442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vz7zd" event={"ID":"2d55b449-511a-4a2c-b30f-335a75a6641c","Type":"ContainerStarted","Data":"2f1965f8fac0de312d02eaacc1a9a6dfcb0de38f38890d669613f7c747fbac86"}
Jul 18 01:48:36.620417 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.620383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs" event={"ID":"4835b2ec-8352-4f0d-86bf-75573f69c465","Type":"ContainerStarted","Data":"8def273a5d8b73af082c63bb5bf9ba65d149c46e52a5c8f6c5166205f4e23b98"}
Jul 18 01:48:36.622125 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.622055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerStarted","Data":"51b4c4d633a8af8cba25dda3d8cc1af45e06247229f3cf624b75bb0756f6015f"}
Jul 18 01:48:36.623695 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.623640    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6vlch" event={"ID":"28a93625-af19-433a-bc86-3783cd839f50","Type":"ContainerStarted","Data":"3e08687a469481213c00f5e3db8e915df9fe161d23c395e84c8727b4ce268521"}
Jul 18 01:48:36.625075 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.625052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-knml9" event={"ID":"f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6","Type":"ContainerStarted","Data":"64be4b24bb3602c2acac52724c9181b5acadeff8f33339c1a570722b10ee9a5c"}
Jul 18 01:48:36.627048 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.627026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"f3c461cdc09953223737058c49a9a4150255a17e25d56b9b27ff2e5df728aed1"}
Jul 18 01:48:36.627123 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.627081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"11793e322ebd0898d55cf8ff7ee3c9fd90ed3dd8e04e67f1fda9a06791efae23"}
Jul 18 01:48:36.627123 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.627111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"76c9b8c96e51036073e2ad0286fc51802eca317b17dddbcd8b93f10cdb0c1178"}
Jul 18 01:48:36.629394 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.629348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbq87" event={"ID":"69d8d9d5-f280-4c42-aed5-411e051b5691","Type":"ContainerStarted","Data":"e245748d79a9882937b3d3d78113edf20d60fb37757878715fbaa2347089a49e"}
Jul 18 01:48:36.630649 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.630619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czwtk" event={"ID":"c12cfd5d-59ec-46e2-82bf-bc22f32d2fed","Type":"ContainerStarted","Data":"846b39acb9a5c67b3f9bfbae9614412289b2a1a61c0c3466d6228867d7b49441"}
Jul 18 01:48:36.631878 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.631857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal" event={"ID":"1b3df1fc75eded3f7d78936d4b1afba9","Type":"ContainerStarted","Data":"8e7223214dd8f2ec79b524e780a893184d01ab240a4150eace95038cd6fad68d"}
Jul 18 01:48:36.632455 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.632411    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vz7zd" podStartSLOduration=2.385944363 podStartE2EDuration="21.632397251s" totalImagesPullingTime="19.246452888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:36.632244073 +0000 UTC m=+24.031643732" watchObservedRunningTime="2026-07-18 01:48:36.632397251 +0000 UTC m=+24.031796910"
Jul 18 01:48:36.633697 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.633676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal" event={"ID":"e688f08ca83892d1676ff730eb85794a","Type":"ContainerStarted","Data":"976874b8a85140f101fb1bd1fba2245c9c56d049af41f854d5995d24036444ed"}
Jul 18 01:48:36.665596 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.665545    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-czwtk" podStartSLOduration=0.710145304 podStartE2EDuration="21.665528282s" totalImagesPullingTime="20.955382978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:36.665497386 +0000 UTC m=+24.064897045" watchObservedRunningTime="2026-07-18 01:48:36.665528282 +0000 UTC m=+24.064927940"
Jul 18 01:48:36.682569 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.682512    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jbq87" podStartSLOduration=0.711261802 podStartE2EDuration="21.68249109s" totalImagesPullingTime="20.971229288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:36.681729831 +0000 UTC m=+24.081129490" watchObservedRunningTime="2026-07-18 01:48:36.68249109 +0000 UTC m=+24.081890752"
Jul 18 01:48:36.695345 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.695029    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-knml9" podStartSLOduration=0.813959933 podStartE2EDuration="21.695010715s" totalImagesPullingTime="20.881050782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:36.694949759 +0000 UTC m=+24.094349421" watchObservedRunningTime="2026-07-18 01:48:36.695010715 +0000 UTC m=+24.094410373"
Jul 18 01:48:36.708212 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.708023    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6vlch" podStartSLOduration=0.851864661 podStartE2EDuration="21.708003304s" totalImagesPullingTime="20.856138643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:36.707535131 +0000 UTC m=+24.106934791" watchObservedRunningTime="2026-07-18 01:48:36.708003304 +0000 UTC m=+24.107402964"
Jul 18 01:48:36.735475 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.735423    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-80.ec2.internal" podStartSLOduration=21.735405009 podStartE2EDuration="21.735405009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:36.735398477 +0000 UTC m=+24.134798149" watchObservedRunningTime="2026-07-18 01:48:36.735405009 +0000 UTC m=+24.134804668"
Jul 18 01:48:36.831721 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.831692    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:36.900647 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:36.900622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:37.231651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.231574    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:37.232239 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.232217    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:37.636702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.636668    2562 generic.go:356] "Generic (PLEG): container finished" podID="df167a9d-85cf-4536-884a-7b0152aaf711" containerID="51b4c4d633a8af8cba25dda3d8cc1af45e06247229f3cf624b75bb0756f6015f" exitCode=0
Jul 18 01:48:37.637265 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.636765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerDied","Data":"51b4c4d633a8af8cba25dda3d8cc1af45e06247229f3cf624b75bb0756f6015f"}
Jul 18 01:48:37.639580 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.639553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"da8a6ac42da067fc98c4979a2c296ff2d253258cb19f2abaf21be05e9bdac182"}
Jul 18 01:48:37.639699 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.639626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"b54066fabcc4f3268e4172cca4101e64edd969ff7f975d266d38f7991fa7ea21"}
Jul 18 01:48:37.639699 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.639668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"a11cda99b4054fb5cf4226b6c5723f9667abd47474b2b21a45a7148eb8555be9"}
Jul 18 01:48:37.641286 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.641260    2562 generic.go:356] "Generic (PLEG): container finished" podID="e688f08ca83892d1676ff730eb85794a" containerID="976874b8a85140f101fb1bd1fba2245c9c56d049af41f854d5995d24036444ed" exitCode=0
Jul 18 01:48:37.641393 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.641365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal" event={"ID":"e688f08ca83892d1676ff730eb85794a","Type":"ContainerDied","Data":"976874b8a85140f101fb1bd1fba2245c9c56d049af41f854d5995d24036444ed"}
Jul 18 01:48:37.641443 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.641405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal" event={"ID":"e688f08ca83892d1676ff730eb85794a","Type":"ContainerStarted","Data":"024c067e0dc39d77c8c4629b60db3d5beaa7969a5c738ccb4fc9d230d5c0f2c2"}
Jul 18 01:48:37.671140 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.671088    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-80.ec2.internal" podStartSLOduration=22.671070833 podStartE2EDuration="22.671070833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:37.670933768 +0000 UTC m=+25.070333426" watchObservedRunningTime="2026-07-18 01:48:37.671070833 +0000 UTC m=+25.070470491"
Jul 18 01:48:37.901177 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:37.901150    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 01:48:38.430839 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.430634    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T01:48:37.901169855Z","UUID":"a8c6e4cb-fcc3-4466-96ec-947e6aaf8c11","Handler":null,"Name":"","Endpoint":""}
Jul 18 01:48:38.432511 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.432474    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 01:48:38.432670 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.432523    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 01:48:38.525362 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.525293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:38.525362 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.525345    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:38.525593 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.525379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:38.525593 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:38.525482    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:38.525593 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:38.525547    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:38.525855 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:38.525623    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:38.646581 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.646540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs" event={"ID":"4835b2ec-8352-4f0d-86bf-75573f69c465","Type":"ContainerStarted","Data":"68c51c358a58c42680518b90b044c94df3e33f343fbc37453034333a45faff8f"}
Jul 18 01:48:38.648296 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.648261    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 01:48:38.648296 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.648261    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k948j" event={"ID":"f6cb1397-abc1-48fb-8859-ec2cab541512","Type":"ContainerStarted","Data":"4541ada0812d14f6865b83ecb4de3944a2fc61d3a6eb64f4ce931184fcfec475"}
Jul 18 01:48:38.664150 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.664091    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k948j" podStartSLOduration=2.8483998550000003 podStartE2EDuration="23.664066004s" totalImagesPullingTime="20.815666149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:38.663568827 +0000 UTC m=+26.062968514" watchObservedRunningTime="2026-07-18 01:48:38.664066004 +0000 UTC m=+26.063465664"
Jul 18 01:48:38.793683 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.793644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:38.887859 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:38.887679    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:39.654645 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:39.654608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"2750fb9a0ddd07249cde7db7b2e97c93944008e692f40257cbd117287da547b7"}
Jul 18 01:48:39.656986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:39.656955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs" event={"ID":"4835b2ec-8352-4f0d-86bf-75573f69c465","Type":"ContainerStarted","Data":"f19fed8cb4af1666a6e703c9a31b59e1d0287b40a9bcea3096e647c0cb703177"}
Jul 18 01:48:40.121759 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.121729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:40.363085 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.363046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:40.422517 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.422439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:40.525038 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.525004    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:40.525038 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.525025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:40.525275 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.525015    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:40.525275 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:40.525148    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:40.525275 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:40.525212    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:40.525452 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:40.525338    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:40.824043 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.824006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:40.925155 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:40.925118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:41.216834 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:41.216801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:41.318708 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:41.318668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:41.715928 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:41.715778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:41.867696 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:41.867671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:42.403552 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.403514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:42.469529 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.469497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:42.525867 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.525835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:42.525867 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.525826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:42.526066 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:42.525962    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:42.526066 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:42.526005    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:42.526066 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.526056    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:42.526170 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:42.526142    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:42.541337 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.541295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:42.621106 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.621062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:42.664439 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.664363    2562 generic.go:356] "Generic (PLEG): container finished" podID="df167a9d-85cf-4536-884a-7b0152aaf711" containerID="c1043bd3699e1f651c0f5f8ef6936373653c032179eeeb2e32f5657d705f24f0" exitCode=0
Jul 18 01:48:42.664582 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.664454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerDied","Data":"c1043bd3699e1f651c0f5f8ef6936373653c032179eeeb2e32f5657d705f24f0"}
Jul 18 01:48:42.668362 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.668336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" event={"ID":"039935a5-7a09-48b1-9784-5a940be1bc4a","Type":"ContainerStarted","Data":"e4f127155c2ff0d0d5043c9cd2782642da1f590c670a33163a339294a0b8f4f5"}
Jul 18 01:48:42.668767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.668582    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:42.668767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.668661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:42.668767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.668711    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:42.676299 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.676272    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:42.683716 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.683696    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:42.683819 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.683790    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:48:42.688556 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.688518    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sjbrs" podStartSLOduration=4.839504768 podStartE2EDuration="27.688505625s" totalImagesPullingTime="22.849000857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:39.67609259 +0000 UTC m=+27.075492251" watchObservedRunningTime="2026-07-18 01:48:42.688505625 +0000 UTC m=+30.087905334"
Jul 18 01:48:42.712311 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:42.712254    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp" podStartSLOduration=6.752895698 podStartE2EDuration="27.712240212s" totalImagesPullingTime="20.959344514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:42.711682878 +0000 UTC m=+30.111082537" watchObservedRunningTime="2026-07-18 01:48:42.712240212 +0000 UTC m=+30.111639865"
Jul 18 01:48:43.190443 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.190408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:43.191090 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.190561    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 18 01:48:43.191090 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.191034    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-knml9"
Jul 18 01:48:43.216335 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.216291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:43.565960 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.565934    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vz7zd_2d55b449-511a-4a2c-b30f-335a75a6641c/dns-node-resolver/0.log"
Jul 18 01:48:43.673028 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.672957    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerStarted","Data":"9897287b5cd6b11ba179cbd59b00e66cd7ae8f5dbfcfabf4b65018aeacf8e8e8"}
Jul 18 01:48:43.690432 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.690404    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4ds8"]
Jul 18 01:48:43.690568 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.690544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:43.690647 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:43.690633    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:43.690952 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.690932    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqbsh"]
Jul 18 01:48:43.691028 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.691018    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:43.691104 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:43.691088    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:43.700797 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.700711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7r5lw"]
Jul 18 01:48:43.700913 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:43.700806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:43.700913 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:43.700896    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:44.369489 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:44.369464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6vlch_28a93625-af19-433a-bc86-3783cd839f50/node-ca/0.log"
Jul 18 01:48:44.458019 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:44.457985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:44.677208 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:44.677125    2562 generic.go:356] "Generic (PLEG): container finished" podID="df167a9d-85cf-4536-884a-7b0152aaf711" containerID="9897287b5cd6b11ba179cbd59b00e66cd7ae8f5dbfcfabf4b65018aeacf8e8e8" exitCode=0
Jul 18 01:48:44.677208 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:44.677199    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerDied","Data":"9897287b5cd6b11ba179cbd59b00e66cd7ae8f5dbfcfabf4b65018aeacf8e8e8"}
Jul 18 01:48:44.748441 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:44.748416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:44.847813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:44.847781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:44.958915 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:44.958834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:45.032776 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.032739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:45.159555 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.159518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:45.525063 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.525022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:45.525063 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.525057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:45.525550 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.525135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:45.525550 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:45.525151    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:45.525550 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:45.525236    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:45.525550 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:45.525360    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:45.682183 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.682086    2562 generic.go:356] "Generic (PLEG): container finished" podID="df167a9d-85cf-4536-884a-7b0152aaf711" containerID="6a1b82d03340191931cc783911287f6b7d1aee4a508767e3a516070b3a0c089f" exitCode=0
Jul 18 01:48:45.682183 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.682164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerDied","Data":"6a1b82d03340191931cc783911287f6b7d1aee4a508767e3a516070b3a0c089f"}
Jul 18 01:48:45.857066 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:45.857036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:46.138987 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:46.138948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:46.561112 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:46.561083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:46.722102 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:46.722070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:46.722265 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:46.722157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:46.722265 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.722211    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:46.722375 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.722266    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:46.722375 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.722293    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret podName:866c3e97-9799-4ba5-9028-ef73eaf3487f nodeName:}" failed. No retries permitted until 2026-07-18 01:49:18.722273305 +0000 UTC m=+66.121672959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret") pod "global-pull-secret-syncer-w4ds8" (UID: "866c3e97-9799-4ba5-9028-ef73eaf3487f") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:48:46.722375 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.722343    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs podName:c38452c4-ccde-4d4d-8e80-49821f53736e nodeName:}" failed. No retries permitted until 2026-07-18 01:49:18.722309858 +0000 UTC m=+66.121709511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs") pod "network-metrics-daemon-wqbsh" (UID: "c38452c4-ccde-4d4d-8e80-49821f53736e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:48:46.751267 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:46.751230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:46.822577 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:46.822488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:46.822741 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.822645    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:48:46.822741 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.822666    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:48:46.822741 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.822679    2562 projected.go:196] Error preparing data for projected volume kube-api-access-gwbfk for pod openshift-network-diagnostics/network-check-target-7r5lw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:46.822901 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:46.822744    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk podName:e7500b7b-2b78-4449-919a-a2233f57cfea nodeName:}" failed. No retries permitted until 2026-07-18 01:49:18.822724468 +0000 UTC m=+66.222124107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwbfk" (UniqueName: "kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk") pod "network-check-target-7r5lw" (UID: "e7500b7b-2b78-4449-919a-a2233f57cfea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:48:46.954689 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:46.954654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:47.166743 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:47.166662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:47.525749 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:47.525718    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:47.525749 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:47.525748    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:47.525979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:47.525757    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:47.525979 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:47.525852    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:47.526095 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:47.525998    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:47.526151 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:47.526102    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:47.750931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:47.750896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:47.955237 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:47.955207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:48.337458 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:48.337425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:48.736606 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:48.736474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:48.797121 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:48.797080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:48.949237 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:48.949209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:49.349550 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:49.349519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:49.525143 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:49.525063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:49.525143 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:49.525095    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:49.525424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:49.525184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:49.525424 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:49.525198    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:49.525424 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:49.525292    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:49.525555 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:49.525434    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:50.145725 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:50.145445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:50.344781 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:50.344748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:50.546952 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:50.546923    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:50.696381 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:50.696293    2562 generic.go:356] "Generic (PLEG): container finished" podID="df167a9d-85cf-4536-884a-7b0152aaf711" containerID="f315f610cfd9ca2f4d23e6fb4fedba86624dc1f0fb211a81ad0484c2e86315e5" exitCode=0
Jul 18 01:48:50.696381 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:50.696358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerDied","Data":"f315f610cfd9ca2f4d23e6fb4fedba86624dc1f0fb211a81ad0484c2e86315e5"}
Jul 18 01:48:50.751016 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:50.750979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:50.936707 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:50.936658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:51.524858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:51.524815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:51.524858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:51.524845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:51.525310 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:51.524832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:51.525310 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:51.524939    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:51.525310 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:51.524996    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:51.525310 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:51.525090    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:51.545594 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:51.545563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:51.703534 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:51.703503    2562 generic.go:356] "Generic (PLEG): container finished" podID="df167a9d-85cf-4536-884a-7b0152aaf711" containerID="58016b696f2cc7b689715bbc3a751b6cea67a34347b8bb839462a1bb76ae9b22" exitCode=0
Jul 18 01:48:51.703704 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:51.703563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerDied","Data":"58016b696f2cc7b689715bbc3a751b6cea67a34347b8bb839462a1bb76ae9b22"}
Jul 18 01:48:51.938104 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:51.938064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:52.336487 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:52.336453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:52.552651 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:52.552621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:52.708538 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:52.708443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" event={"ID":"df167a9d-85cf-4536-884a-7b0152aaf711","Type":"ContainerStarted","Data":"4b87ab0ffb508a1fda465927714e59b91a1b133bdf4b177bbca5377989546a09"}
Jul 18 01:48:52.943021 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:52.942990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:53.263721 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.263690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:53.369468 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.369439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:53.525156 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.525125    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:53.525306 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.525224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:53.525364 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:53.525336    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:53.525429 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.525229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:53.525429 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:53.525224    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:53.525504 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:53.525453    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:53.549753 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.549718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:53.744206 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.744173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:53.939893 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:53.939798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:54.154977 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:54.154947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:54.343791 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:54.343757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:54.421336 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:54.421289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:54.512648 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:54.512617    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:54.579442 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:54.579409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:54.946563 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:54.946531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:55.142107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:55.142077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:55.525006 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:55.524973    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:55.525190 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:55.525066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:55.525190 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:55.525072    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:55.525190 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:55.525097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:55.525306 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:55.525191    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:55.525306 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:55.525254    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:55.539989 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:55.539964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:56.232868 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:56.232839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:56.333439 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:56.333412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:48:57.524856 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:57.524824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:57.525230 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:57.524922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:57.525230 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:57.524933    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:48:57.525230 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:57.525007    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:57.525230 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:57.525014    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:57.525230 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:57.525081    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:59.525523 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:59.525482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:48:59.525523 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:59.525525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:48:59.526008 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:48:59.525489    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:48:59.526008 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:59.525594    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:48:59.526008 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:59.525674    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:48:59.526008 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:48:59.525754    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:49:01.525450 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:01.525412    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:49:01.525944 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:01.525411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:49:01.525944 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:01.525531    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:49:01.525944 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:01.525411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:01.525944 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:01.525610    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:49:01.525944 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:01.525677    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:49:03.525189 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:03.525157    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:03.525564 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:03.525249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:49:03.525564 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:03.525259    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:49:03.525564 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:03.525255    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:49:03.525564 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:03.525342    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:49:03.525564 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:03.525409    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:49:03.917349 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:03.917258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:04.021444 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:04.021416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:04.334833 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:04.334802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:04.518706 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:04.518669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:04.616475 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:04.616391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:05.282530 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.282502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:05.383277 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.383239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:05.525470 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.525436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:49:05.525666 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.525538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:05.525666 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:05.525542    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4ds8" podUID="866c3e97-9799-4ba5-9028-ef73eaf3487f"
Jul 18 01:49:05.525666 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.525589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:49:05.525833 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:05.525680    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7r5lw" podUID="e7500b7b-2b78-4449-919a-a2233f57cfea"
Jul 18 01:49:05.525833 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:05.525793    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wqbsh" podUID="c38452c4-ccde-4d4d-8e80-49821f53736e"
Jul 18 01:49:05.706067 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.705985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:05.823677 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.823642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:05.918922 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.918886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:05.945857 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.945831    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-80.ec2.internal" event="NodeReady"
Jul 18 01:49:05.946005 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:05.945960    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 01:49:06.028206 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.028137    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5dxcv" podStartSLOduration=19.839086145 podStartE2EDuration="51.028115158s" totalImagesPullingTime="31.189029013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:48:52.737393034 +0000 UTC m=+40.136792693" watchObservedRunningTime="2026-07-18 01:49:06.028115158 +0000 UTC m=+53.427514821"
Jul 18 01:49:06.028804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.028788    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x8zcg"]
Jul 18 01:49:06.042921 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.042893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:06.049904 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.049888    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hj6j4"]
Jul 18 01:49:06.050014 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.049999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.057664 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.057435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ml5qw\""
Jul 18 01:49:06.057840 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.057820    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 01:49:06.058128 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.058074    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 01:49:06.067782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.067758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8zcg"]
Jul 18 01:49:06.067903 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.067860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.071056 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.071031    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 01:49:06.071179 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.071040    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 01:49:06.071179 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.071082    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 01:49:06.071179 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.071132    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 01:49:06.071835 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.071818    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zn9g6\""
Jul 18 01:49:06.080763 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.080741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hj6j4"]
Jul 18 01:49:06.150156 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.150119    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vv6p6"]
Jul 18 01:49:06.159169 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e2456a-ebdf-4a99-b7a3-54bc1847458e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.159313 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02e2456a-ebdf-4a99-b7a3-54bc1847458e-crio-socket\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.159313 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19099886-e214-4a73-be60-0db2bbaff0bf-config-volume\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.159313 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpg66\" (UniqueName: \"kubernetes.io/projected/02e2456a-ebdf-4a99-b7a3-54bc1847458e-kube-api-access-xpg66\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.159313 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qslwz\" (UniqueName: \"kubernetes.io/projected/19099886-e214-4a73-be60-0db2bbaff0bf-kube-api-access-qslwz\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.159313 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19099886-e214-4a73-be60-0db2bbaff0bf-metrics-tls\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.159535 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02e2456a-ebdf-4a99-b7a3-54bc1847458e-data-volume\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.159535 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19099886-e214-4a73-be60-0db2bbaff0bf-tmp-dir\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.159535 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.159443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e2456a-ebdf-4a99-b7a3-54bc1847458e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.169285 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.169265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.170609 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.170586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vv6p6"]
Jul 18 01:49:06.171739 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.171716    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pf5pc\""
Jul 18 01:49:06.172381 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.172357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 01:49:06.172482 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.172387    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 01:49:06.172811 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.172795    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 01:49:06.217232 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.217195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:06.260456 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02e2456a-ebdf-4a99-b7a3-54bc1847458e-crio-socket\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.260622 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19099886-e214-4a73-be60-0db2bbaff0bf-config-volume\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.260622 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpg66\" (UniqueName: \"kubernetes.io/projected/02e2456a-ebdf-4a99-b7a3-54bc1847458e-kube-api-access-xpg66\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.260622 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xrc\" (UniqueName: \"kubernetes.io/projected/8e1b824e-d8dd-4822-8faa-ce068ec8e33d-kube-api-access-k9xrc\") pod \"ingress-canary-vv6p6\" (UID: \"8e1b824e-d8dd-4822-8faa-ce068ec8e33d\") " pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.260622 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qslwz\" (UniqueName: \"kubernetes.io/projected/19099886-e214-4a73-be60-0db2bbaff0bf-kube-api-access-qslwz\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.260622 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19099886-e214-4a73-be60-0db2bbaff0bf-metrics-tls\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.260622 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02e2456a-ebdf-4a99-b7a3-54bc1847458e-data-volume\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.260911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02e2456a-ebdf-4a99-b7a3-54bc1847458e-crio-socket\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.260911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19099886-e214-4a73-be60-0db2bbaff0bf-tmp-dir\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.260911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e2456a-ebdf-4a99-b7a3-54bc1847458e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.260911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e1b824e-d8dd-4822-8faa-ce068ec8e33d-cert\") pod \"ingress-canary-vv6p6\" (UID: \"8e1b824e-d8dd-4822-8faa-ce068ec8e33d\") " pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.260911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e2456a-ebdf-4a99-b7a3-54bc1847458e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.261103 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19099886-e214-4a73-be60-0db2bbaff0bf-tmp-dir\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.261103 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.260983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02e2456a-ebdf-4a99-b7a3-54bc1847458e-data-volume\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.261164 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.261106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19099886-e214-4a73-be60-0db2bbaff0bf-config-volume\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.261398 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.261374    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02e2456a-ebdf-4a99-b7a3-54bc1847458e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.264595 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.264569    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19099886-e214-4a73-be60-0db2bbaff0bf-metrics-tls\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.264678 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.264611    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02e2456a-ebdf-4a99-b7a3-54bc1847458e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.269547 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.269515    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qslwz\" (UniqueName: \"kubernetes.io/projected/19099886-e214-4a73-be60-0db2bbaff0bf-kube-api-access-qslwz\") pod \"dns-default-x8zcg\" (UID: \"19099886-e214-4a73-be60-0db2bbaff0bf\") " pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.269652 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.269585    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpg66\" (UniqueName: \"kubernetes.io/projected/02e2456a-ebdf-4a99-b7a3-54bc1847458e-kube-api-access-xpg66\") pod \"insights-runtime-extractor-hj6j4\" (UID: \"02e2456a-ebdf-4a99-b7a3-54bc1847458e\") " pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.322655 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.322578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:06.362014 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.361981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e1b824e-d8dd-4822-8faa-ce068ec8e33d-cert\") pod \"ingress-canary-vv6p6\" (UID: \"8e1b824e-d8dd-4822-8faa-ce068ec8e33d\") " pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.362118 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.362023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xrc\" (UniqueName: \"kubernetes.io/projected/8e1b824e-d8dd-4822-8faa-ce068ec8e33d-kube-api-access-k9xrc\") pod \"ingress-canary-vv6p6\" (UID: \"8e1b824e-d8dd-4822-8faa-ce068ec8e33d\") " pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.362354 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.362315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:06.364589 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.364558    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e1b824e-d8dd-4822-8faa-ce068ec8e33d-cert\") pod \"ingress-canary-vv6p6\" (UID: \"8e1b824e-d8dd-4822-8faa-ce068ec8e33d\") " pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.369357 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.369318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xrc\" (UniqueName: \"kubernetes.io/projected/8e1b824e-d8dd-4822-8faa-ce068ec8e33d-kube-api-access-k9xrc\") pod \"ingress-canary-vv6p6\" (UID: \"8e1b824e-d8dd-4822-8faa-ce068ec8e33d\") " pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.376155 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.376137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hj6j4"
Jul 18 01:49:06.414634 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.414606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:06.485962 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.483463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vv6p6"
Jul 18 01:49:06.592124 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.592038    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8zcg"]
Jul 18 01:49:06.595846 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:06.595813    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19099886_e214_4a73_be60_0db2bbaff0bf.slice/crio-d9990b2d7d625d4c2c987082cda646cfd76370dacc19072cba71cc57fb042c0d WatchSource:0}: Error finding container d9990b2d7d625d4c2c987082cda646cfd76370dacc19072cba71cc57fb042c0d: Status 404 returned error can't find the container with id d9990b2d7d625d4c2c987082cda646cfd76370dacc19072cba71cc57fb042c0d
Jul 18 01:49:06.597939 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.597912    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hj6j4"]
Jul 18 01:49:06.601761 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:06.601734    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e2456a_ebdf_4a99_b7a3_54bc1847458e.slice/crio-6a41c0aec896fbfdf23ba2a4fb70762ddcd09f7434908bc03f778473b3ea13ae WatchSource:0}: Error finding container 6a41c0aec896fbfdf23ba2a4fb70762ddcd09f7434908bc03f778473b3ea13ae: Status 404 returned error can't find the container with id 6a41c0aec896fbfdf23ba2a4fb70762ddcd09f7434908bc03f778473b3ea13ae
Jul 18 01:49:06.640926 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.640897    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vv6p6"]
Jul 18 01:49:06.644040 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:06.644014    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1b824e_d8dd_4822_8faa_ce068ec8e33d.slice/crio-a977bb57e3998d4ccd6d2d4e23651708616128c2400198ebe5af40ae78f29033 WatchSource:0}: Error finding container a977bb57e3998d4ccd6d2d4e23651708616128c2400198ebe5af40ae78f29033: Status 404 returned error can't find the container with id a977bb57e3998d4ccd6d2d4e23651708616128c2400198ebe5af40ae78f29033
Jul 18 01:49:06.739235 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.739193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vv6p6" event={"ID":"8e1b824e-d8dd-4822-8faa-ce068ec8e33d","Type":"ContainerStarted","Data":"a977bb57e3998d4ccd6d2d4e23651708616128c2400198ebe5af40ae78f29033"}
Jul 18 01:49:06.740237 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.740206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hj6j4" event={"ID":"02e2456a-ebdf-4a99-b7a3-54bc1847458e","Type":"ContainerStarted","Data":"6a41c0aec896fbfdf23ba2a4fb70762ddcd09f7434908bc03f778473b3ea13ae"}
Jul 18 01:49:06.741238 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:06.741218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8zcg" event={"ID":"19099886-e214-4a73-be60-0db2bbaff0bf","Type":"ContainerStarted","Data":"d9990b2d7d625d4c2c987082cda646cfd76370dacc19072cba71cc57fb042c0d"}
Jul 18 01:49:07.525344 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.525290    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:07.525668 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.525630    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:49:07.526105 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.525990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:49:07.529856 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.529821    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqgxz\""
Jul 18 01:49:07.530064 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.530048    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:49:07.530286 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.530266    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vwvlx\""
Jul 18 01:49:07.530905 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.530885    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:49:07.531155 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.531141    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 01:49:07.531370 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:07.531354    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 01:49:09.540124 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.540084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:09.571061 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.571024    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"]
Jul 18 01:49:09.591654 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.591618    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"]
Jul 18 01:49:09.591813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.591727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.594187 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.594157    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 01:49:09.595060 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.595032    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 01:49:09.595060 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.595058    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 18 01:49:09.595271 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.595096    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wn6hl\""
Jul 18 01:49:09.595271 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.595115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 18 01:49:09.595271 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.595032    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 01:49:09.615524 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.615489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:09.690108 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.690068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/296a69b7-1957-4b88-9ef0-05f114a29e46-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.690265 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.690173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.690265 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.690230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.690265 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.690251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jws4\" (UniqueName: \"kubernetes.io/projected/296a69b7-1957-4b88-9ef0-05f114a29e46-kube-api-access-5jws4\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.791551 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.791464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.791551 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.791522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.791739 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:09.791618    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 18 01:49:09.791739 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.791629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jws4\" (UniqueName: \"kubernetes.io/projected/296a69b7-1957-4b88-9ef0-05f114a29e46-kube-api-access-5jws4\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.791739 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.791675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/296a69b7-1957-4b88-9ef0-05f114a29e46-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.791739 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:09.791691    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-tls podName:296a69b7-1957-4b88-9ef0-05f114a29e46 nodeName:}" failed. No retries permitted until 2026-07-18 01:49:10.291670099 +0000 UTC m=+57.691069756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-tq97x" (UID: "296a69b7-1957-4b88-9ef0-05f114a29e46") : secret "prometheus-operator-tls" not found
Jul 18 01:49:09.792248 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.792228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/296a69b7-1957-4b88-9ef0-05f114a29e46-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.794095 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.794062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.800206 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.800185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jws4\" (UniqueName: \"kubernetes.io/projected/296a69b7-1957-4b88-9ef0-05f114a29e46-kube-api-access-5jws4\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:09.932428 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:09.932398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:10.296059 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:10.296013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:10.298758 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:10.298736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/296a69b7-1957-4b88-9ef0-05f114a29e46-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq97x\" (UID: \"296a69b7-1957-4b88-9ef0-05f114a29e46\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:10.500853 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:10.500818    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"
Jul 18 01:49:12.737417 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:12.737311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:12.796219 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:12.796187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:13.313062 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.313014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tq97x"]
Jul 18 01:49:13.763338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.763285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8zcg" event={"ID":"19099886-e214-4a73-be60-0db2bbaff0bf","Type":"ContainerStarted","Data":"7325c8f74797f0c3e60d0eaf09953fe791670aadd4383fa3d2a3bb85b87512c3"}
Jul 18 01:49:13.763908 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.763376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8zcg" event={"ID":"19099886-e214-4a73-be60-0db2bbaff0bf","Type":"ContainerStarted","Data":"761553a3b6341840552d386d41e543c9d7f384d6e1f3bc4e4c8bbb34fdb13780"}
Jul 18 01:49:13.763908 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.763705    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:13.765597 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.765566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hj6j4" event={"ID":"02e2456a-ebdf-4a99-b7a3-54bc1847458e","Type":"ContainerStarted","Data":"3872f92ee9132c8602def2444099d42ff040f009408cfaeca5f1da164e2bd95f"}
Jul 18 01:49:13.767458 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.767387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x" event={"ID":"296a69b7-1957-4b88-9ef0-05f114a29e46","Type":"ContainerStarted","Data":"420faab3c5ccb3c250e6b2805aaf39b4396fd7ea7f671e1239d58f39b4f86e3f"}
Jul 18 01:49:13.769281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.769253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vv6p6" event={"ID":"8e1b824e-d8dd-4822-8faa-ce068ec8e33d","Type":"ContainerStarted","Data":"99ad5e4cf62b0f5a1d158940da6826de596715dcc502be3742b409ac164fb916"}
Jul 18 01:49:13.781837 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.781782    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x8zcg" podStartSLOduration=2.221920558 podStartE2EDuration="8.78176336s" totalImagesPullingTime="6.559842802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:13.781444917 +0000 UTC m=+61.180844610" watchObservedRunningTime="2026-07-18 01:49:13.78176336 +0000 UTC m=+61.181163021"
Jul 18 01:49:13.799081 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:13.799023    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vv6p6" podStartSLOduration=1.286771941 podStartE2EDuration="7.799007371s" totalImagesPullingTime="6.51223543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:13.798451557 +0000 UTC m=+61.197851217" watchObservedRunningTime="2026-07-18 01:49:13.799007371 +0000 UTC m=+61.198407031"
Jul 18 01:49:14.141274 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.141176    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-788b7c9cd7-zvngk"]
Jul 18 01:49:14.143281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.143257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.145837 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.145810    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 01:49:14.146070 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.146054    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 01:49:14.146269 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.146253    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 18 01:49:14.147004 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.146642    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 18 01:49:14.147004 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.146704    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qcq5b\""
Jul 18 01:49:14.147004 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.146846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 18 01:49:14.147004 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.146923    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 18 01:49:14.147286 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.147070    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 18 01:49:14.154501 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.154439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788b7c9cd7-zvngk"]
Jul 18 01:49:14.228567 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.228498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-service-ca\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.228567 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.228545    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-oauth-serving-cert\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.228897 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.228576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnp8q\" (UniqueName: \"kubernetes.io/projected/d67ff44d-b285-4705-b580-8903d971117c-kube-api-access-dnp8q\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.228897 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.228607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-console-config\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.228897 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.228697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-serving-cert\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.228897 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.228764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-oauth-config\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.330198 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.329991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-serving-cert\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.330198 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.330068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-oauth-config\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.330198 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.330125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-service-ca\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.330513 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.330266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-oauth-serving-cert\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.330513 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.330307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnp8q\" (UniqueName: \"kubernetes.io/projected/d67ff44d-b285-4705-b580-8903d971117c-kube-api-access-dnp8q\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.330513 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.330365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-console-config\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.331357 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.331309    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-service-ca\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.331475 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.331420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-console-config\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.331793 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.331766    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-oauth-serving-cert\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.333094 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.333066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-serving-cert\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.333693 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.333644    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-oauth-config\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.343450 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.343408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnp8q\" (UniqueName: \"kubernetes.io/projected/d67ff44d-b285-4705-b580-8903d971117c-kube-api-access-dnp8q\") pod \"console-788b7c9cd7-zvngk\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") " pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.456556 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.456466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:14.688630 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.688604    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm6qp"
Jul 18 01:49:14.775766 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.775254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x" event={"ID":"296a69b7-1957-4b88-9ef0-05f114a29e46","Type":"ContainerStarted","Data":"cff553d886843ef37db8b87dbc282b7f51b3afaab717b573a2a610c10292b3ac"}
Jul 18 01:49:14.797012 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.796984    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788b7c9cd7-zvngk"]
Jul 18 01:49:14.801431 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:14.801289    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67ff44d_b285_4705_b580_8903d971117c.slice/crio-a00d47bfc204852545eb8cfbb0613ce4fadf816bf9c638bc606af90fd4aebaec WatchSource:0}: Error finding container a00d47bfc204852545eb8cfbb0613ce4fadf816bf9c638bc606af90fd4aebaec: Status 404 returned error can't find the container with id a00d47bfc204852545eb8cfbb0613ce4fadf816bf9c638bc606af90fd4aebaec
Jul 18 01:49:14.863983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.863946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:14.966565 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:14.966439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:15.067128 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:15.066858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:15.164821 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:15.164735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:15.223395 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:15.223294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:15.780311 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:15.780254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x" event={"ID":"296a69b7-1957-4b88-9ef0-05f114a29e46","Type":"ContainerStarted","Data":"711b1b11902d491c4ec7c0dc13625b86497f304efbf7a6965c2e2f42ff3f4c85"}
Jul 18 01:49:15.781669 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:15.781630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b7c9cd7-zvngk" event={"ID":"d67ff44d-b285-4705-b580-8903d971117c","Type":"ContainerStarted","Data":"a00d47bfc204852545eb8cfbb0613ce4fadf816bf9c638bc606af90fd4aebaec"}
Jul 18 01:49:15.798902 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:15.798838    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq97x" podStartSLOduration=5.442929592 podStartE2EDuration="6.798813059s" totalImagesPullingTime="1.355883467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:15.796951817 +0000 UTC m=+63.196351504" watchObservedRunningTime="2026-07-18 01:49:15.798813059 +0000 UTC m=+63.198212721"
Jul 18 01:49:17.247456 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.247362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:17.348257 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.348216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:17.667233 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.667145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:17.792935 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.792874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hj6j4" event={"ID":"02e2456a-ebdf-4a99-b7a3-54bc1847458e","Type":"ContainerStarted","Data":"d737a6871aa63c4cec50ca9bafa2eb9849ebc8f1aeed842e90ecaf6f2ae7fa8d"}
Jul 18 01:49:17.877214 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.877151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:17.898466 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.898334    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"]
Jul 18 01:49:17.900935 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.900908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:17.903309 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.903135    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vw7jg\""
Jul 18 01:49:17.903309 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.903229    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 18 01:49:17.903617 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.903562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 18 01:49:17.916229 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.916203    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"]
Jul 18 01:49:17.916566 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.916547    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t9zsb"]
Jul 18 01:49:17.919078 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.919020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.921740 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.921503    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 01:49:17.921740 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.921584    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 01:49:17.921740 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.921594    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 01:49:17.922108 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.922087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jzc4s\""
Jul 18 01:49:17.937238 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.937218    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-42xxg"]
Jul 18 01:49:17.939716 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.939696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:17.942586 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.942305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-z98j7\""
Jul 18 01:49:17.943064 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.942797    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 18 01:49:17.943064 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.942921    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 18 01:49:17.943064 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.942980    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 18 01:49:17.962813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.962779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-tls\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.962992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.962835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:17.962992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.962860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-sys\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.962992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.962925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.963154 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-textfile\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.963154 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d9mr\" (UniqueName: \"kubernetes.io/projected/6adc182a-5682-46e7-a076-82eaf81021be-kube-api-access-5d9mr\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.963154 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6adc182a-5682-46e7-a076-82eaf81021be-metrics-client-ca\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.963154 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-root\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.963154 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.963421 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:17.963421 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-wtmp\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:17.963421 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158e6022-101e-42b1-8620-3c94f45ce302-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:17.963421 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.963360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzcf8\" (UniqueName: \"kubernetes.io/projected/158e6022-101e-42b1-8620-3c94f45ce302-kube-api-access-xzcf8\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:17.973774 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.973711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-42xxg"]
Jul 18 01:49:17.986578 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:17.986540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.064597 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.064767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.064767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.064767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62a7bf56-c0c4-4712-afed-de5da6ada7be-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.064767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a7bf56-c0c4-4712-afed-de5da6ada7be-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.064767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-wtmp\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.064767 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158e6022-101e-42b1-8620-3c94f45ce302-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzcf8\" (UniqueName: \"kubernetes.io/projected/158e6022-101e-42b1-8620-3c94f45ce302-kube-api-access-xzcf8\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-tls\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-sys\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrnmt\" (UniqueName: \"kubernetes.io/projected/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-api-access-rrnmt\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.064987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-textfile\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065082 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d9mr\" (UniqueName: \"kubernetes.io/projected/6adc182a-5682-46e7-a076-82eaf81021be-kube-api-access-5d9mr\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065511 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.065511 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6adc182a-5682-46e7-a076-82eaf81021be-metrics-client-ca\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065511 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-root\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065511 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-root\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065511 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.065345    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 18 01:49:18.065511 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.065401    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-tls podName:6adc182a-5682-46e7-a076-82eaf81021be nodeName:}" failed. No retries permitted until 2026-07-18 01:49:18.565381886 +0000 UTC m=+65.964781543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-tls") pod "node-exporter-t9zsb" (UID: "6adc182a-5682-46e7-a076-82eaf81021be") : secret "node-exporter-tls" not found
Jul 18 01:49:18.065511 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-wtmp\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.065857 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.065643    2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 18 01:49:18.065857 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.065692    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-tls podName:158e6022-101e-42b1-8620-3c94f45ce302 nodeName:}" failed. No retries permitted until 2026-07-18 01:49:18.565676923 +0000 UTC m=+65.965076562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-dwcp4" (UID: "158e6022-101e-42b1-8620-3c94f45ce302") : secret "openshift-state-metrics-tls" not found
Jul 18 01:49:18.065857 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.065735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6adc182a-5682-46e7-a076-82eaf81021be-sys\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.066835 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.066313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.066835 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.066315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-textfile\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.066835 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.066362    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158e6022-101e-42b1-8620-3c94f45ce302-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.066835 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.066791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6adc182a-5682-46e7-a076-82eaf81021be-metrics-client-ca\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.068019 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.067997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.068259 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.068236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.075697 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.075672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d9mr\" (UniqueName: \"kubernetes.io/projected/6adc182a-5682-46e7-a076-82eaf81021be-kube-api-access-5d9mr\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.077107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.077013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzcf8\" (UniqueName: \"kubernetes.io/projected/158e6022-101e-42b1-8620-3c94f45ce302-kube-api-access-xzcf8\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.087812 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.087765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.166340 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.166291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.166522 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.166356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrnmt\" (UniqueName: \"kubernetes.io/projected/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-api-access-rrnmt\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.166522 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.166410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.166522 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.166467    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 18 01:49:18.166657 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.166552    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls podName:62a7bf56-c0c4-4712-afed-de5da6ada7be nodeName:}" failed. No retries permitted until 2026-07-18 01:49:18.666530577 +0000 UTC m=+66.065930220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-42xxg" (UID: "62a7bf56-c0c4-4712-afed-de5da6ada7be") : secret "kube-state-metrics-tls" not found
Jul 18 01:49:18.166657 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.166467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.166852 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.166745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62a7bf56-c0c4-4712-afed-de5da6ada7be-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.166852 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.166792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a7bf56-c0c4-4712-afed-de5da6ada7be-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.167192 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.167162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62a7bf56-c0c4-4712-afed-de5da6ada7be-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.167301 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.167231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.167395 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.167383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62a7bf56-c0c4-4712-afed-de5da6ada7be-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.169706 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.169646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.175115 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.175012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrnmt\" (UniqueName: \"kubernetes.io/projected/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-api-access-rrnmt\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.185512 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.185426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.284541 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.284506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.385203 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.385170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.460390 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.460268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.570462 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.570427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-tls\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.570661 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.570487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.573727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.573691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6adc182a-5682-46e7-a076-82eaf81021be-node-exporter-tls\") pod \"node-exporter-t9zsb\" (UID: \"6adc182a-5682-46e7-a076-82eaf81021be\") " pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.573871 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.573758    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/158e6022-101e-42b1-8620-3c94f45ce302-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-dwcp4\" (UID: \"158e6022-101e-42b1-8620-3c94f45ce302\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.646601 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.646568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.672222 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.672074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:18.672451 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.672255    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 18 01:49:18.672451 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:18.672364    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls podName:62a7bf56-c0c4-4712-afed-de5da6ada7be nodeName:}" failed. No retries permitted until 2026-07-18 01:49:19.672337596 +0000 UTC m=+67.071737245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-42xxg" (UID: "62a7bf56-c0c4-4712-afed-de5da6ada7be") : secret "kube-state-metrics-tls" not found
Jul 18 01:49:18.773317 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.773275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:49:18.773529 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.773368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:49:18.775799 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.775774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:49:18.775920 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.775799    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:49:18.786428 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.786371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/866c3e97-9799-4ba5-9028-ef73eaf3487f-original-pull-secret\") pod \"global-pull-secret-syncer-w4ds8\" (UID: \"866c3e97-9799-4ba5-9028-ef73eaf3487f\") " pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:49:18.786567 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.786439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c38452c4-ccde-4d4d-8e80-49821f53736e-metrics-certs\") pod \"network-metrics-daemon-wqbsh\" (UID: \"c38452c4-ccde-4d4d-8e80-49821f53736e\") " pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:49:18.813051 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.813002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"
Jul 18 01:49:18.830251 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.830214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9zsb"
Jul 18 01:49:18.873896 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.873863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:18.876295 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.876270    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 01:49:18.886251 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.886226    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 01:49:18.897629 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.897597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwbfk\" (UniqueName: \"kubernetes.io/projected/e7500b7b-2b78-4449-919a-a2233f57cfea-kube-api-access-gwbfk\") pod \"network-check-target-7r5lw\" (UID: \"e7500b7b-2b78-4449-919a-a2233f57cfea\") " pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:18.945131 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.945095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:18.946291 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.946272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vwvlx\""
Jul 18 01:49:18.954230 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.954201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:18.955143 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.955129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tqgxz\""
Jul 18 01:49:18.961947 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.961927    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4ds8"
Jul 18 01:49:18.964046 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:18.964030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wqbsh"
Jul 18 01:49:19.035791 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.035684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:19.038871 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.038840    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:49:19.065858 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.065825    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:49:19.066107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.065979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.069479 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.069456    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 18 01:49:19.069640 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.069624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 18 01:49:19.069698 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.069656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 18 01:49:19.069914 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.069895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 18 01:49:19.070192 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.070169    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 18 01:49:19.070594 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.070568    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 18 01:49:19.070691 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.070572    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 18 01:49:19.070691 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.070679    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qrm7f\""
Jul 18 01:49:19.070815 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.070577    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 18 01:49:19.071240 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.071222    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 18 01:49:19.153018 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.152984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:19.176188 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc8nq\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-kube-api-access-zc8nq\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176382 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176382 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176382 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176382 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176382 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-config-out\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-web-config\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.176633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.176630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277498 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277733 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-web-config\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277733 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277733 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc8nq\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-kube-api-access-zc8nq\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277852 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277852 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277852 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277852 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-config-out\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.277992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.277986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.278303 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:19.278278    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 18 01:49:19.278419 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.278367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.278419 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:19.278391    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls podName:e6265133-1d2b-4785-959e-8afe1b78325a nodeName:}" failed. No retries permitted until 2026-07-18 01:49:19.778367699 +0000 UTC m=+67.177767360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a") : secret "alertmanager-main-tls" not found
Jul 18 01:49:19.279448 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:19.279425    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle podName:e6265133-1d2b-4785-959e-8afe1b78325a nodeName:}" failed. No retries permitted until 2026-07-18 01:49:19.779404352 +0000 UTC m=+67.178803990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a") : configmap references non-existent config key: ca-bundle.crt
Jul 18 01:49:19.279710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.279679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.280785 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.280739    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.281525 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.281495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-config-out\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.281525 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.281517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.281712 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.281665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.281812 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.281787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-web-config\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.282159 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.282105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.282533 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.282502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.283352 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.283311    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.287659 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.287595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc8nq\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-kube-api-access-zc8nq\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.444159 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.444120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:19.512853 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.512818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:19.612333 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.612213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:19.681566 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.681531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:19.684396 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.684366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62a7bf56-c0c4-4712-afed-de5da6ada7be-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-42xxg\" (UID: \"62a7bf56-c0c4-4712-afed-de5da6ada7be\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:19.751470 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.751430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg"
Jul 18 01:49:19.782816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.782777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.783006 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.782897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.783804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.783778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.785737 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.785710    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:19.987937 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:19.987852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:49:20.711107 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:20.711068    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adc182a_5682_46e7_a076_82eaf81021be.slice/crio-2ed172e58732bc394e405f7c8e2cd32db3df12235c24e1e0e29850e541d3ac92 WatchSource:0}: Error finding container 2ed172e58732bc394e405f7c8e2cd32db3df12235c24e1e0e29850e541d3ac92: Status 404 returned error can't find the container with id 2ed172e58732bc394e405f7c8e2cd32db3df12235c24e1e0e29850e541d3ac92
Jul 18 01:49:20.829223 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.828926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9zsb" event={"ID":"6adc182a-5682-46e7-a076-82eaf81021be","Type":"ContainerStarted","Data":"2ed172e58732bc394e405f7c8e2cd32db3df12235c24e1e0e29850e541d3ac92"}
Jul 18 01:49:20.868935 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.868671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:20.936396 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.936361    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4ds8"]
Jul 18 01:49:20.950562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.950233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:20.960268 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.960212    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b49687679-98bxp"]
Jul 18 01:49:20.968641 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.968615    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:20.971231 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.971204    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ejac7ik675glo\""
Jul 18 01:49:20.971231 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.971218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 18 01:49:20.971419 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.971367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 18 01:49:20.971419 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.971379    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qznr2\""
Jul 18 01:49:20.971547 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.971486    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 18 01:49:20.971911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.971879    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 18 01:49:20.971911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.971887    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 18 01:49:20.976645 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:20.976491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b49687679-98bxp"]
Jul 18 01:49:21.094607 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.094567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec85967c-e020-4b7f-98f3-6d4cddb7d918-metrics-client-ca\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.094913 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.094660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.094913 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.094831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.094913 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.094873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.094913 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.094910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-tls\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.095142 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.094947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctpc7\" (UniqueName: \"kubernetes.io/projected/ec85967c-e020-4b7f-98f3-6d4cddb7d918-kube-api-access-ctpc7\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.095142 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.094982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.095142 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.095038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-grpc-tls\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.148023 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.147456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4"]
Jul 18 01:49:21.151240 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.151212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:21.152803 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:21.152773    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158e6022_101e_42b1_8620_3c94f45ce302.slice/crio-40e1fb4644ab4ddc88768ab6d7e712d007a11e2071ac5a917ba437e2ab0de168 WatchSource:0}: Error finding container 40e1fb4644ab4ddc88768ab6d7e712d007a11e2071ac5a917ba437e2ab0de168: Status 404 returned error can't find the container with id 40e1fb4644ab4ddc88768ab6d7e712d007a11e2071ac5a917ba437e2ab0de168
Jul 18 01:49:21.192309 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.192270    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7r5lw"]
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.195805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.195863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.195896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.195812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wqbsh"]
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.195937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-tls\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.195977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctpc7\" (UniqueName: \"kubernetes.io/projected/ec85967c-e020-4b7f-98f3-6d4cddb7d918-kube-api-access-ctpc7\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.196014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.196075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-grpc-tls\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.196243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.196102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec85967c-e020-4b7f-98f3-6d4cddb7d918-metrics-client-ca\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.197360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.197201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec85967c-e020-4b7f-98f3-6d4cddb7d918-metrics-client-ca\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.197360 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:21.197308    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7500b7b_2b78_4449_919a_a2233f57cfea.slice/crio-a9906c677a1854b69ffa8a5f41703ea1995b17cfd8f9f7eb3d7dfb3e7482cfe6 WatchSource:0}: Error finding container a9906c677a1854b69ffa8a5f41703ea1995b17cfd8f9f7eb3d7dfb3e7482cfe6: Status 404 returned error can't find the container with id a9906c677a1854b69ffa8a5f41703ea1995b17cfd8f9f7eb3d7dfb3e7482cfe6
Jul 18 01:49:21.203389 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.200921    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-42xxg"]
Jul 18 01:49:21.203389 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.200939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-grpc-tls\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.203389 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.202730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.203389 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.202812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.203389 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.203129    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.205473 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.203576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-tls\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.205473 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.204104    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:49:21.205473 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.204482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec85967c-e020-4b7f-98f3-6d4cddb7d918-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.205473 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:21.205186    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38452c4_ccde_4d4d_8e80_49821f53736e.slice/crio-8a54035ddbebce5c857014ba7546556e03ff274e15b3968adc83b688de0f2d9d WatchSource:0}: Error finding container 8a54035ddbebce5c857014ba7546556e03ff274e15b3968adc83b688de0f2d9d: Status 404 returned error can't find the container with id 8a54035ddbebce5c857014ba7546556e03ff274e15b3968adc83b688de0f2d9d
Jul 18 01:49:21.210746 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:21.210702    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6265133_1d2b_4785_959e_8afe1b78325a.slice/crio-3cbe5a2a12a63ed94ae5dbebf7947178f8c9f31c5a06850acd2c3ff29c89a8cd WatchSource:0}: Error finding container 3cbe5a2a12a63ed94ae5dbebf7947178f8c9f31c5a06850acd2c3ff29c89a8cd: Status 404 returned error can't find the container with id 3cbe5a2a12a63ed94ae5dbebf7947178f8c9f31c5a06850acd2c3ff29c89a8cd
Jul 18 01:49:21.212677 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.212610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctpc7\" (UniqueName: \"kubernetes.io/projected/ec85967c-e020-4b7f-98f3-6d4cddb7d918-kube-api-access-ctpc7\") pod \"thanos-querier-5b49687679-98bxp\" (UID: \"ec85967c-e020-4b7f-98f3-6d4cddb7d918\") " pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.242606 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.242576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:21.279495 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.279463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:21.448234 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.448133    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b49687679-98bxp"]
Jul 18 01:49:21.591294 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:21.591261    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec85967c_e020_4b7f_98f3_6d4cddb7d918.slice/crio-959b2260c7f1a67cf440b77022383f7cc0ea95114d6ae695be789f0a1624fee0 WatchSource:0}: Error finding container 959b2260c7f1a67cf440b77022383f7cc0ea95114d6ae695be789f0a1624fee0: Status 404 returned error can't find the container with id 959b2260c7f1a67cf440b77022383f7cc0ea95114d6ae695be789f0a1624fee0
Jul 18 01:49:21.842559 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.841637    2562 generic.go:356] "Generic (PLEG): container finished" podID="6adc182a-5682-46e7-a076-82eaf81021be" containerID="c8d510ec6cc463c971e4e10d9644ec570c11bbc3629742d2886e273ab28ec501" exitCode=0
Jul 18 01:49:21.842559 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.841730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9zsb" event={"ID":"6adc182a-5682-46e7-a076-82eaf81021be","Type":"ContainerDied","Data":"c8d510ec6cc463c971e4e10d9644ec570c11bbc3629742d2886e273ab28ec501"}
Jul 18 01:49:21.846570 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.845757    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg" event={"ID":"62a7bf56-c0c4-4712-afed-de5da6ada7be","Type":"ContainerStarted","Data":"d62e4d808ab463fd8245526d4c660d6437554cc5f0f6c2b94aae69885d0ab657"}
Jul 18 01:49:21.850307 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.849864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b7c9cd7-zvngk" event={"ID":"d67ff44d-b285-4705-b580-8903d971117c","Type":"ContainerStarted","Data":"dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b"}
Jul 18 01:49:21.854087 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.853972    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerStarted","Data":"3cbe5a2a12a63ed94ae5dbebf7947178f8c9f31c5a06850acd2c3ff29c89a8cd"}
Jul 18 01:49:21.859469 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.859303    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7r5lw" event={"ID":"e7500b7b-2b78-4449-919a-a2233f57cfea","Type":"ContainerStarted","Data":"a9906c677a1854b69ffa8a5f41703ea1995b17cfd8f9f7eb3d7dfb3e7482cfe6"}
Jul 18 01:49:21.864087 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.863582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4" event={"ID":"158e6022-101e-42b1-8620-3c94f45ce302","Type":"ContainerStarted","Data":"915ba27e2ceb57ccfdba50b6caa1c0b5cbab55050eacff1da4c5c9e1c3426965"}
Jul 18 01:49:21.864087 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.863649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4" event={"ID":"158e6022-101e-42b1-8620-3c94f45ce302","Type":"ContainerStarted","Data":"073994357f261213054e3059f5cf7fc0c4337dfe69d2d8ea29b530a62e7267c6"}
Jul 18 01:49:21.864087 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.863682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4" event={"ID":"158e6022-101e-42b1-8620-3c94f45ce302","Type":"ContainerStarted","Data":"40e1fb4644ab4ddc88768ab6d7e712d007a11e2071ac5a917ba437e2ab0de168"}
Jul 18 01:49:21.872357 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.871689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hj6j4" event={"ID":"02e2456a-ebdf-4a99-b7a3-54bc1847458e","Type":"ContainerStarted","Data":"7bd1992716d4acd2a90893a95680eb9c133de43293ef71eebc607b6bb4e2f8fa"}
Jul 18 01:49:21.874053 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.873962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" event={"ID":"ec85967c-e020-4b7f-98f3-6d4cddb7d918","Type":"ContainerStarted","Data":"959b2260c7f1a67cf440b77022383f7cc0ea95114d6ae695be789f0a1624fee0"}
Jul 18 01:49:21.878550 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.878522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqbsh" event={"ID":"c38452c4-ccde-4d4d-8e80-49821f53736e","Type":"ContainerStarted","Data":"8a54035ddbebce5c857014ba7546556e03ff274e15b3968adc83b688de0f2d9d"}
Jul 18 01:49:21.883849 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.883619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4ds8" event={"ID":"866c3e97-9799-4ba5-9028-ef73eaf3487f","Type":"ContainerStarted","Data":"0a2a6ea7bf9c654064accf8b7426915dc22d7e6a75a832f24b2dd8dcd28d9d8f"}
Jul 18 01:49:21.904404 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:21.903225    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-788b7c9cd7-zvngk" podStartSLOduration=1.990222829 podStartE2EDuration="7.903202864s" totalImagesPullingTime="5.912980035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:21.883367283 +0000 UTC m=+69.282766939" watchObservedRunningTime="2026-07-18 01:49:21.903202864 +0000 UTC m=+69.302602524"
Jul 18 01:49:22.688202 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:22.688106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:22.787213 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:22.787142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:22.896280 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:22.893384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9zsb" event={"ID":"6adc182a-5682-46e7-a076-82eaf81021be","Type":"ContainerStarted","Data":"4ab4b91dbaa0fffcf24a998d61515bbcb77a2012cbea5c7473a5fe756e2ff8d0"}
Jul 18 01:49:22.896280 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:22.893455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9zsb" event={"ID":"6adc182a-5682-46e7-a076-82eaf81021be","Type":"ContainerStarted","Data":"9058df9e54a5860fbe093402a68aca848b77e8e9e93c3d43c39be33d68669e55"}
Jul 18 01:49:22.918229 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:22.917892    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hj6j4" podStartSLOduration=2.957838654 podStartE2EDuration="16.917865224s" totalImagesPullingTime="13.96002657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:49:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:21.904460129 +0000 UTC m=+69.303859813" watchObservedRunningTime="2026-07-18 01:49:22.917865224 +0000 UTC m=+70.317264886"
Jul 18 01:49:22.920039 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:22.919473    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t9zsb" podStartSLOduration=4.913726683 podStartE2EDuration="5.919457041s" totalImagesPullingTime="904.390938ms" totalInitContainerRuntime="101.33942ms" isStatefulPod=true podCreationTimestamp="2026-07-18 01:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:22.918609917 +0000 UTC m=+70.318009576" watchObservedRunningTime="2026-07-18 01:49:22.919457041 +0000 UTC m=+70.318856693"
Jul 18 01:49:22.990864 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:22.990739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:23.193464 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.190469    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"]
Jul 18 01:49:23.198925 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.198889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.201555 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.201425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 18 01:49:23.201555 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.201459    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 18 01:49:23.202029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.201774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 18 01:49:23.202029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.201804    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 18 01:49:23.202029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.201857    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 18 01:49:23.202029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.201887    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8rgdn\""
Jul 18 01:49:23.207727 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.207640    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"]
Jul 18 01:49:23.211240 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.211201    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 18 01:49:23.319087 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-serving-certs-ca-bundle\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.319376 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-telemeter-client-tls\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.319376 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-federate-client-tls\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.319376 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-metrics-client-ca\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.319376 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.319376 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.319376 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dl6q\" (UniqueName: \"kubernetes.io/projected/caef0234-857e-4bb3-8391-f2e002872b8d-kube-api-access-2dl6q\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.319791 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.319397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-secret-telemeter-client\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.345283 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.345237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:23.420871 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.420831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.421055 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.420946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dl6q\" (UniqueName: \"kubernetes.io/projected/caef0234-857e-4bb3-8391-f2e002872b8d-kube-api-access-2dl6q\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.421055 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.420995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-secret-telemeter-client\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.421171 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.421070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-serving-certs-ca-bundle\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.421171 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.421106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-telemeter-client-tls\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.421171 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.421150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-federate-client-tls\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.421355 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.421205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-metrics-client-ca\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.421355 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.421275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.423158 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.422339    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.423158 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.422642    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-metrics-client-ca\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.423158 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.423023    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caef0234-857e-4bb3-8391-f2e002872b8d-serving-certs-ca-bundle\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.424909 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.424886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-federate-client-tls\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.426069 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.425469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-telemeter-client-tls\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.427155 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.427128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-secret-telemeter-client\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.428122 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.428076    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caef0234-857e-4bb3-8391-f2e002872b8d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.430442 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.430413    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dl6q\" (UniqueName: \"kubernetes.io/projected/caef0234-857e-4bb3-8391-f2e002872b8d-kube-api-access-2dl6q\") pod \"telemeter-client-654c8fbc6c-7vdnz\" (UID: \"caef0234-857e-4bb3-8391-f2e002872b8d\") " pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.514397 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.514353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"
Jul 18 01:49:23.544734 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.543261    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6d674dbd-4dgnt"]
Jul 18 01:49:23.547642 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.547608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.559762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.559610    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6d674dbd-4dgnt"]
Jul 18 01:49:23.560818 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.560792    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 18 01:49:23.625130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.624668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-oauth-config\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.625130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.624727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-config\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.625130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.624796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-trusted-ca-bundle\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.625130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.624844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42px\" (UniqueName: \"kubernetes.io/projected/c250d2c4-a49f-40e2-95d4-52d478e5a119-kube-api-access-d42px\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.625130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.624875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-serving-cert\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.625130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.624927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-service-ca\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.625130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.624950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-oauth-serving-cert\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.726266 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.726205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-service-ca\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.726266 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.726255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-oauth-serving-cert\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.726548 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.726290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-oauth-config\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.726548 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.726338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-config\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.726548 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.726409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-trusted-ca-bundle\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.726548 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.726457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d42px\" (UniqueName: \"kubernetes.io/projected/c250d2c4-a49f-40e2-95d4-52d478e5a119-kube-api-access-d42px\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.726548 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.726485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-serving-cert\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.727688 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.727353    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-service-ca\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.727815 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.727733    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-trusted-ca-bundle\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.727815 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.727801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-config\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.728083 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.728041    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-oauth-serving-cert\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.730960 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.730923    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-oauth-config\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.731703 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.731648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-serving-cert\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.737094 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.737072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42px\" (UniqueName: \"kubernetes.io/projected/c250d2c4-a49f-40e2-95d4-52d478e5a119-kube-api-access-d42px\") pod \"console-6d6d674dbd-4dgnt\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") " pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:23.778860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.778749    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x8zcg"
Jul 18 01:49:23.863483 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:23.863446    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:24.168525 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.168436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:24.251167 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.248638    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:49:24.254512 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.254472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.256503 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.256472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:24.257000 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.256976    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 01:49:24.257289 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.256976    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 01:49:24.257408 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.257302    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.259033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.259370    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.259598    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.259807    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.260466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.260721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.260786    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 01:49:24.260979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.260977    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h8sbn\""
Jul 18 01:49:24.261448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.261136    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 01:49:24.261448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.261205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 01:49:24.261448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.261250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 01:49:24.261448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.261397    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 01:49:24.261448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.261420    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-80b7if4l41hj1\""
Jul 18 01:49:24.263925 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.263583    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 01:49:24.273990 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.272480    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:49:24.342468 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.342659 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.342659 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342545    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.342659 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.342659 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.342894 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.342946 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343093 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.342982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343093 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-web-config\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343213 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343270 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343341 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343400 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-config-out\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343451 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-config\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343508 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343508 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343707 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.343707 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.343659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgxtm\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-kube-api-access-kgxtm\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-config\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgxtm\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-kube-api-access-kgxtm\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.444975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-web-config\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.445710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.445382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-config-out\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.446230 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.446203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.447742 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.446401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.447742 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.446405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.447742 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.446516    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.447742 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.446685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.447742 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.447431    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.448058 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.447864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.450137 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.450113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.450333 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.450114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-web-config\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.450799 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.450768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.450997 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.450950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.451932 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.451908    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.452586 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.452562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.453566 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.453433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.453566 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.453523    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-config\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.454444 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.454401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.455217 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.455175    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-config-out\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.456143 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.456090    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.456259 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.456141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.457034 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.457002    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:24.457147 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.457092    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:24.461021 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.460967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgxtm\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-kube-api-access-kgxtm\") pod \"prometheus-k8s-0\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.463258 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.463238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:24.494112 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.494071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:24.577045 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.577003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:24.589299 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.589256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:24.906807 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:24.906779    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:49:25.349222 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:25.349187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:25.449975 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:25.449942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:26.399679 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:26.399637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:26.491412 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:26.491374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:27.147023 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.146998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:27.358555 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.357110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6d674dbd-4dgnt"]
Jul 18 01:49:27.400977 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:27.400944    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc250d2c4_a49f_40e2_95d4_52d478e5a119.slice/crio-c58215a1b241640cc62cfde4c0f94e1f86e384f287c424b0c614dfc82e44c673 WatchSource:0}: Error finding container c58215a1b241640cc62cfde4c0f94e1f86e384f287c424b0c614dfc82e44c673: Status 404 returned error can't find the container with id c58215a1b241640cc62cfde4c0f94e1f86e384f287c424b0c614dfc82e44c673
Jul 18 01:49:27.416555 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.416526    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz"]
Jul 18 01:49:27.422066 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.422010    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:49:27.424614 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:27.423850    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaef0234_857e_4bb3_8391_f2e002872b8d.slice/crio-27b9a0b0090174f1b73a08f462684338339c36d4a11f8ae4e8677cb60662d8b9 WatchSource:0}: Error finding container 27b9a0b0090174f1b73a08f462684338339c36d4a11f8ae4e8677cb60662d8b9: Status 404 returned error can't find the container with id 27b9a0b0090174f1b73a08f462684338339c36d4a11f8ae4e8677cb60662d8b9
Jul 18 01:49:27.438412 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:49:27.437994    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc133546c_fe4a_4f90_a2c4_261b70959a65.slice/crio-e08f097dbd8164cd59eedcdc515be939d30c0f9cb1be7530c3ffd7a0776a3143 WatchSource:0}: Error finding container e08f097dbd8164cd59eedcdc515be939d30c0f9cb1be7530c3ffd7a0776a3143: Status 404 returned error can't find the container with id e08f097dbd8164cd59eedcdc515be939d30c0f9cb1be7530c3ffd7a0776a3143
Jul 18 01:49:27.916175 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.916080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg" event={"ID":"62a7bf56-c0c4-4712-afed-de5da6ada7be","Type":"ContainerStarted","Data":"0f113614c9394b4132429eb09ef705f44f9ca37798b667de2c5092546712c554"}
Jul 18 01:49:27.916175 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.916147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg" event={"ID":"62a7bf56-c0c4-4712-afed-de5da6ada7be","Type":"ContainerStarted","Data":"729b409cbfd035c00c6343b75ab2e0c8a0e411a0793345c33ded9f4ec21291b1"}
Jul 18 01:49:27.916435 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.916179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg" event={"ID":"62a7bf56-c0c4-4712-afed-de5da6ada7be","Type":"ContainerStarted","Data":"011f30165ea42fab1cf982df28bd3e26e9c0c757bd978c480b2dccda1a8a79f1"}
Jul 18 01:49:27.917369 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.917317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz" event={"ID":"caef0234-857e-4bb3-8391-f2e002872b8d","Type":"ContainerStarted","Data":"27b9a0b0090174f1b73a08f462684338339c36d4a11f8ae4e8677cb60662d8b9"}
Jul 18 01:49:27.920992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.920930    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6265133-1d2b-4785-959e-8afe1b78325a" containerID="af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda" exitCode=0
Jul 18 01:49:27.921135 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.921015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda"}
Jul 18 01:49:27.923036 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.923007    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7r5lw" event={"ID":"e7500b7b-2b78-4449-919a-a2233f57cfea","Type":"ContainerStarted","Data":"fb7c854c8ff256416cad662f3754615942e58a5b200fccdbf697c19a91e3e151"}
Jul 18 01:49:27.923156 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.923138    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:27.925436 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.925400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4" event={"ID":"158e6022-101e-42b1-8620-3c94f45ce302","Type":"ContainerStarted","Data":"dfbca98a143bad867f10a9f93914b957f9f647ec54859c9811b4005b8a4aa515"}
Jul 18 01:49:27.927226 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.927203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d674dbd-4dgnt" event={"ID":"c250d2c4-a49f-40e2-95d4-52d478e5a119","Type":"ContainerStarted","Data":"1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed"}
Jul 18 01:49:27.927310 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.927244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d674dbd-4dgnt" event={"ID":"c250d2c4-a49f-40e2-95d4-52d478e5a119","Type":"ContainerStarted","Data":"c58215a1b241640cc62cfde4c0f94e1f86e384f287c424b0c614dfc82e44c673"}
Jul 18 01:49:27.929838 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.929818    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" event={"ID":"ec85967c-e020-4b7f-98f3-6d4cddb7d918","Type":"ContainerStarted","Data":"947a037d51225a49c39a6fbb61bfcd9cd879554b02da05b2b49a87326ac0993c"}
Jul 18 01:49:27.929945 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.929882    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" event={"ID":"ec85967c-e020-4b7f-98f3-6d4cddb7d918","Type":"ContainerStarted","Data":"06d54a342ed65719b876975fa7771dc37be2a73b055e9783ed780a61408eba65"}
Jul 18 01:49:27.929990 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.929973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" event={"ID":"ec85967c-e020-4b7f-98f3-6d4cddb7d918","Type":"ContainerStarted","Data":"99906c0e0da64faa5f67b16abd804ed76b648e38ef10e9e3d2ae9826e0c74f83"}
Jul 18 01:49:27.931496 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.931474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqbsh" event={"ID":"c38452c4-ccde-4d4d-8e80-49821f53736e","Type":"ContainerStarted","Data":"7b1ecc452e146fdbde8ef681e769e75e528e87278e7a509929a31374877ab2c6"}
Jul 18 01:49:27.931600 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.931509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wqbsh" event={"ID":"c38452c4-ccde-4d4d-8e80-49821f53736e","Type":"ContainerStarted","Data":"5385a2bda184cbf71ae0bfa1a0d249808e301ba9097c870a058938f42e294d30"}
Jul 18 01:49:27.933070 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.933049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4ds8" event={"ID":"866c3e97-9799-4ba5-9028-ef73eaf3487f","Type":"ContainerStarted","Data":"4672ae4e8c208d01f70ff7341595a2e5404d2e5a0d2a65e7c15ca409ab4e4998"}
Jul 18 01:49:27.934592 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.934571    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerID="23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6" exitCode=0
Jul 18 01:49:27.934669 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.934601    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6"}
Jul 18 01:49:27.934708 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.934665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerStarted","Data":"e08f097dbd8164cd59eedcdc515be939d30c0f9cb1be7530c3ffd7a0776a3143"}
Jul 18 01:49:27.938678 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.938638    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-42xxg" podStartSLOduration=5.010519149 podStartE2EDuration="10.938622864s" totalImagesPullingTime="5.928103715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:27.937553694 +0000 UTC m=+75.336953355" watchObservedRunningTime="2026-07-18 01:49:27.938622864 +0000 UTC m=+75.338022523"
Jul 18 01:49:27.960878 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:27.960827    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6d674dbd-4dgnt" podStartSLOduration=4.960797961 podStartE2EDuration="4.960797961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:27.960726936 +0000 UTC m=+75.360126585" watchObservedRunningTime="2026-07-18 01:49:27.960797961 +0000 UTC m=+75.360197619"
Jul 18 01:49:28.012153 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.012079    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w4ds8" podStartSLOduration=66.78701637099999 podStartE2EDuration="1m13.012057437s" totalImagesPullingTime="6.225041066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:27.977755306 +0000 UTC m=+75.377154961" watchObservedRunningTime="2026-07-18 01:49:28.012057437 +0000 UTC m=+75.411457088"
Jul 18 01:49:28.028141 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.028085    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7r5lw" podStartSLOduration=67.061234587 podStartE2EDuration="1m13.028070593s" totalImagesPullingTime="5.966836006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:28.026464892 +0000 UTC m=+75.425864553" watchObservedRunningTime="2026-07-18 01:49:28.028070593 +0000 UTC m=+75.427470296"
Jul 18 01:49:28.044939 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.044886    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wqbsh" podStartSLOduration=67.119463005 podStartE2EDuration="1m13.04486776s" totalImagesPullingTime="5.925404755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:28.044017736 +0000 UTC m=+75.443417408" watchObservedRunningTime="2026-07-18 01:49:28.04486776 +0000 UTC m=+75.444267419"
Jul 18 01:49:28.061529 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.061481    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dwcp4" podStartSLOduration=6.693941892 podStartE2EDuration="11.061465798s" totalImagesPullingTime="4.367523906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:28.060703374 +0000 UTC m=+75.460103033" watchObservedRunningTime="2026-07-18 01:49:28.061465798 +0000 UTC m=+75.460865457"
Jul 18 01:49:28.153616 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.153576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:28.251832 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.251789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:28.948917 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.948738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" event={"ID":"ec85967c-e020-4b7f-98f3-6d4cddb7d918","Type":"ContainerStarted","Data":"f4c675e99809f97dc6a53429c64a36e48f8d9334cd5e44935e9447bdd4b2ceef"}
Jul 18 01:49:28.948917 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.948813    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" event={"ID":"ec85967c-e020-4b7f-98f3-6d4cddb7d918","Type":"ContainerStarted","Data":"b9170b749a969a38692aba7c5c99c6ed1d0203bf37bd4b2ea4c2b2dc79e506c7"}
Jul 18 01:49:28.948917 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.948857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" event={"ID":"ec85967c-e020-4b7f-98f3-6d4cddb7d918","Type":"ContainerStarted","Data":"e1af4c4bf94c483d800928b9144b31ef46ec5243c6b8ecb9ad6db1248cf9845e"}
Jul 18 01:49:28.949506 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.949399    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:28.976246 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:28.974958    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp" podStartSLOduration=2.6424600910000002 podStartE2EDuration="8.974928155s" totalImagesPullingTime="6.332468064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:28.974124816 +0000 UTC m=+76.373524472" watchObservedRunningTime="2026-07-18 01:49:28.974928155 +0000 UTC m=+76.374327815"
Jul 18 01:49:29.390134 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:29.390079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:29.449196 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:29.449152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:30.959867 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:30.959822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz" event={"ID":"caef0234-857e-4bb3-8391-f2e002872b8d","Type":"ContainerStarted","Data":"e31893d8e2fd2e5b50cef7d8aafb34f98a02c40a0b795225b7f743e40e30a789"}
Jul 18 01:49:30.960366 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:30.959902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz" event={"ID":"caef0234-857e-4bb3-8391-f2e002872b8d","Type":"ContainerStarted","Data":"07796f5b35239b3c14f5a4e95cf04db875169cd7030f39162cd0dbb96f0ea589"}
Jul 18 01:49:30.962462 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:30.962438    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerStarted","Data":"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"}
Jul 18 01:49:30.962580 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:30.962499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerStarted","Data":"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"}
Jul 18 01:49:31.973986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.973950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerStarted","Data":"32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1"}
Jul 18 01:49:31.974436 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.974064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerStarted","Data":"23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed"}
Jul 18 01:49:31.974436 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.974100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerStarted","Data":"8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387"}
Jul 18 01:49:31.974436 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.974126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerStarted","Data":"fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0"}
Jul 18 01:49:31.974436 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.974169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerStarted","Data":"3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52"}
Jul 18 01:49:31.974436 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.974195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerStarted","Data":"f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a"}
Jul 18 01:49:31.976162 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.976129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz" event={"ID":"caef0234-857e-4bb3-8391-f2e002872b8d","Type":"ContainerStarted","Data":"9542e2a8b808f1d7b8d6495f198ac2c2718cb8bc7401f597e9dc0c6a49b2c1a5"}
Jul 18 01:49:31.979726 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.979703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerStarted","Data":"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"}
Jul 18 01:49:31.979816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.979758    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerStarted","Data":"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"}
Jul 18 01:49:31.979816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.979784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerStarted","Data":"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"}
Jul 18 01:49:31.979884 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:31.979821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerStarted","Data":"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"}
Jul 18 01:49:32.004168 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:32.004117    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.460641725 podStartE2EDuration="8.004103279s" totalImagesPullingTime="3.492971403s" totalInitContainerRuntime="50.490151ms" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:32.001389914 +0000 UTC m=+79.400789573" watchObservedRunningTime="2026-07-18 01:49:32.004103279 +0000 UTC m=+79.403502938"
Jul 18 01:49:32.027694 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:32.027645    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.905058643 podStartE2EDuration="13.027628202s" totalImagesPullingTime="8.103150639s" totalInitContainerRuntime="19.41892ms" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:32.02544767 +0000 UTC m=+79.424847333" watchObservedRunningTime="2026-07-18 01:49:32.027628202 +0000 UTC m=+79.427027860"
Jul 18 01:49:32.047882 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:32.047820    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-654c8fbc6c-7vdnz" podStartSLOduration=6.379858507 podStartE2EDuration="9.047797493s" totalImagesPullingTime="2.667938986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:49:32.047230653 +0000 UTC m=+79.446630313" watchObservedRunningTime="2026-07-18 01:49:32.047797493 +0000 UTC m=+79.447197153"
Jul 18 01:49:32.794221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:32.794186    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6d674dbd-4dgnt"]
Jul 18 01:49:32.930048 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:32.930016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:33.864493 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:33.864459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:34.577243 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:34.577086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:49:34.959992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:34.959903    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b49687679-98bxp"
Jul 18 01:49:35.260281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:35.260250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:35.360589 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:35.360553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:37.067995 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:37.067959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:37.203271 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:37.203229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:37.302001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:37.301948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:43.688457 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:43.688413    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788b7c9cd7-zvngk"]
Jul 18 01:49:43.796462 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:43.796415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:43.897795 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:43.897741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:43.963387 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:43.963253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:47.703669 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:47.703616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:47.804901 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:47.804847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:50.265139 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:50.265071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:50.365642 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:50.365594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:52.800565 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:52.800514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:52.898674 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:52.898598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:49:57.815234 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:57.815170    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d6d674dbd-4dgnt" podUID="c250d2c4-a49f-40e2-95d4-52d478e5a119" containerName="console" containerID="cri-o://1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed" gracePeriod=15
Jul 18 01:49:58.604621 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.604589    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:58.664005 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.663966    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-config\") pod \"c250d2c4-a49f-40e2-95d4-52d478e5a119\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") "
Jul 18 01:49:58.664005 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664003    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d42px\" (UniqueName: \"kubernetes.io/projected/c250d2c4-a49f-40e2-95d4-52d478e5a119-kube-api-access-d42px\") pod \"c250d2c4-a49f-40e2-95d4-52d478e5a119\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") "
Jul 18 01:49:58.664220 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664047    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-oauth-config\") pod \"c250d2c4-a49f-40e2-95d4-52d478e5a119\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") "
Jul 18 01:49:58.664220 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-trusted-ca-bundle\") pod \"c250d2c4-a49f-40e2-95d4-52d478e5a119\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") "
Jul 18 01:49:58.664220 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664102    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-serving-cert\") pod \"c250d2c4-a49f-40e2-95d4-52d478e5a119\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") "
Jul 18 01:49:58.664220 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-oauth-serving-cert\") pod \"c250d2c4-a49f-40e2-95d4-52d478e5a119\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") "
Jul 18 01:49:58.664220 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664186    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-service-ca\") pod \"c250d2c4-a49f-40e2-95d4-52d478e5a119\" (UID: \"c250d2c4-a49f-40e2-95d4-52d478e5a119\") "
Jul 18 01:49:58.664611 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664504    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-config" (OuterVolumeSpecName: "console-config") pod "c250d2c4-a49f-40e2-95d4-52d478e5a119" (UID: "c250d2c4-a49f-40e2-95d4-52d478e5a119"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:49:58.664730 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664615    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c250d2c4-a49f-40e2-95d4-52d478e5a119" (UID: "c250d2c4-a49f-40e2-95d4-52d478e5a119"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:49:58.664730 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664690    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c250d2c4-a49f-40e2-95d4-52d478e5a119" (UID: "c250d2c4-a49f-40e2-95d4-52d478e5a119"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:49:58.664730 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.664710    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-service-ca" (OuterVolumeSpecName: "service-ca") pod "c250d2c4-a49f-40e2-95d4-52d478e5a119" (UID: "c250d2c4-a49f-40e2-95d4-52d478e5a119"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:49:58.666567 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.666540    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c250d2c4-a49f-40e2-95d4-52d478e5a119" (UID: "c250d2c4-a49f-40e2-95d4-52d478e5a119"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:49:58.666887 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.666853    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c250d2c4-a49f-40e2-95d4-52d478e5a119" (UID: "c250d2c4-a49f-40e2-95d4-52d478e5a119"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:49:58.666974 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.666880    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c250d2c4-a49f-40e2-95d4-52d478e5a119-kube-api-access-d42px" (OuterVolumeSpecName: "kube-api-access-d42px") pod "c250d2c4-a49f-40e2-95d4-52d478e5a119" (UID: "c250d2c4-a49f-40e2-95d4-52d478e5a119"). InnerVolumeSpecName "kube-api-access-d42px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:49:58.765816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.765726    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-serving-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:49:58.765816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.765764    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-oauth-serving-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:49:58.765816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.765775    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:49:58.765816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.765785    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:49:58.765816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.765794    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d42px\" (UniqueName: \"kubernetes.io/projected/c250d2c4-a49f-40e2-95d4-52d478e5a119-kube-api-access-d42px\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:49:58.765816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.765804    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c250d2c4-a49f-40e2-95d4-52d478e5a119-console-oauth-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:49:58.765816 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.765814    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c250d2c4-a49f-40e2-95d4-52d478e5a119-trusted-ca-bundle\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:49:58.952087 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:58.952058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7r5lw"
Jul 18 01:49:59.105068 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.104983    2562 generic.go:356] "Generic (PLEG): container finished" podID="c250d2c4-a49f-40e2-95d4-52d478e5a119" containerID="1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed" exitCode=0
Jul 18 01:49:59.105068 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.105030    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d674dbd-4dgnt"
Jul 18 01:49:59.105251 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.105066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d674dbd-4dgnt" event={"ID":"c250d2c4-a49f-40e2-95d4-52d478e5a119","Type":"ContainerDied","Data":"1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed"}
Jul 18 01:49:59.105251 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.105114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d674dbd-4dgnt" event={"ID":"c250d2c4-a49f-40e2-95d4-52d478e5a119","Type":"ContainerDied","Data":"c58215a1b241640cc62cfde4c0f94e1f86e384f287c424b0c614dfc82e44c673"}
Jul 18 01:49:59.105251 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.105137    2562 scope.go:117] "RemoveContainer" containerID="1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed"
Jul 18 01:49:59.114424 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.114304    2562 scope.go:117] "RemoveContainer" containerID="1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed"
Jul 18 01:49:59.114635 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:49:59.114611    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed\": container with ID starting with 1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed not found: ID does not exist" containerID="1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed"
Jul 18 01:49:59.114681 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.114647    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed"} err="failed to get container status \"1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed\": rpc error: code = NotFound desc = could not find container \"1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed\": container with ID starting with 1f64ab186171488014157d2ee8e6e41fa5e3458502019e4c4fcbfe1c47ee27ed not found: ID does not exist"
Jul 18 01:49:59.126484 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.126461    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6d674dbd-4dgnt"]
Jul 18 01:49:59.132225 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:49:59.132197    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6d674dbd-4dgnt"]
Jul 18 01:50:00.530990 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:00.530947    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c250d2c4-a49f-40e2-95d4-52d478e5a119" path="/var/lib/kubelet/pods/c250d2c4-a49f-40e2-95d4-52d478e5a119/volumes"
Jul 18 01:50:08.709080 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:08.709012    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-788b7c9cd7-zvngk" podUID="d67ff44d-b285-4705-b580-8903d971117c" containerName="console" containerID="cri-o://dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b" gracePeriod=15
Jul 18 01:50:08.949153 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:08.949129    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:50:09.062696 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.062663    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnp8q\" (UniqueName: \"kubernetes.io/projected/d67ff44d-b285-4705-b580-8903d971117c-kube-api-access-dnp8q\") pod \"d67ff44d-b285-4705-b580-8903d971117c\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") "
Jul 18 01:50:09.062900 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.062723    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-oauth-serving-cert\") pod \"d67ff44d-b285-4705-b580-8903d971117c\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") "
Jul 18 01:50:09.062900 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.062744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-oauth-config\") pod \"d67ff44d-b285-4705-b580-8903d971117c\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") "
Jul 18 01:50:09.062900 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.062766    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-console-config\") pod \"d67ff44d-b285-4705-b580-8903d971117c\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") "
Jul 18 01:50:09.062900 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.062786    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-service-ca\") pod \"d67ff44d-b285-4705-b580-8903d971117c\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") "
Jul 18 01:50:09.062900 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.062881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-serving-cert\") pod \"d67ff44d-b285-4705-b580-8903d971117c\" (UID: \"d67ff44d-b285-4705-b580-8903d971117c\") "
Jul 18 01:50:09.063242 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.063208    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d67ff44d-b285-4705-b580-8903d971117c" (UID: "d67ff44d-b285-4705-b580-8903d971117c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:09.063380 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.063230    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-console-config" (OuterVolumeSpecName: "console-config") pod "d67ff44d-b285-4705-b580-8903d971117c" (UID: "d67ff44d-b285-4705-b580-8903d971117c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:09.063380 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.063208    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d67ff44d-b285-4705-b580-8903d971117c" (UID: "d67ff44d-b285-4705-b580-8903d971117c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:09.065078 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.065041    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d67ff44d-b285-4705-b580-8903d971117c" (UID: "d67ff44d-b285-4705-b580-8903d971117c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:09.065154 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.065070    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67ff44d-b285-4705-b580-8903d971117c-kube-api-access-dnp8q" (OuterVolumeSpecName: "kube-api-access-dnp8q") pod "d67ff44d-b285-4705-b580-8903d971117c" (UID: "d67ff44d-b285-4705-b580-8903d971117c"). InnerVolumeSpecName "kube-api-access-dnp8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:50:09.065154 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.065088    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d67ff44d-b285-4705-b580-8903d971117c" (UID: "d67ff44d-b285-4705-b580-8903d971117c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:09.146597 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.146562    2562 generic.go:356] "Generic (PLEG): container finished" podID="d67ff44d-b285-4705-b580-8903d971117c" containerID="dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b" exitCode=0
Jul 18 01:50:09.146813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.146612    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788b7c9cd7-zvngk"
Jul 18 01:50:09.146813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.146612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b7c9cd7-zvngk" event={"ID":"d67ff44d-b285-4705-b580-8903d971117c","Type":"ContainerDied","Data":"dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b"}
Jul 18 01:50:09.146813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.146752    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788b7c9cd7-zvngk" event={"ID":"d67ff44d-b285-4705-b580-8903d971117c","Type":"ContainerDied","Data":"a00d47bfc204852545eb8cfbb0613ce4fadf816bf9c638bc606af90fd4aebaec"}
Jul 18 01:50:09.146813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.146774    2562 scope.go:117] "RemoveContainer" containerID="dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b"
Jul 18 01:50:09.155953 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.155934    2562 scope.go:117] "RemoveContainer" containerID="dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b"
Jul 18 01:50:09.156243 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:09.156222    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b\": container with ID starting with dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b not found: ID does not exist" containerID="dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b"
Jul 18 01:50:09.156343 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.156251    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b"} err="failed to get container status \"dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b\": rpc error: code = NotFound desc = could not find container \"dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b\": container with ID starting with dc279bf405421adf9b79b82d42b7c4365a824fb0e3ab39d6dcad9f4b7061be4b not found: ID does not exist"
Jul 18 01:50:09.164270 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.164208    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-oauth-serving-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:09.164270 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.164237    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-oauth-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:09.164270 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.164248    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-console-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:09.164270 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.164256    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67ff44d-b285-4705-b580-8903d971117c-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:09.164270 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.164266    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67ff44d-b285-4705-b580-8903d971117c-console-serving-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:09.164645 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.164281    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnp8q\" (UniqueName: \"kubernetes.io/projected/d67ff44d-b285-4705-b580-8903d971117c-kube-api-access-dnp8q\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:09.165951 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.165892    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788b7c9cd7-zvngk"]
Jul 18 01:50:09.167804 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:09.167781    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-788b7c9cd7-zvngk"]
Jul 18 01:50:10.529892 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:10.529857    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67ff44d-b285-4705-b580-8903d971117c" path="/var/lib/kubelet/pods/d67ff44d-b285-4705-b580-8903d971117c/volumes"
Jul 18 01:50:24.577946 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:24.577894    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:24.599254 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:24.599225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:25.229659 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:25.229617    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:34.062368 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:34.062314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:34.163268 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:34.163232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:37.795485 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:37.795444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:37.848315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:37.848280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:38.295395 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:38.295361    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:50:38.295666 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:38.295642    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="alertmanager" containerID="cri-o://d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54" gracePeriod=120
Jul 18 01:50:38.295738 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:38.295711    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-metric" containerID="cri-o://794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62" gracePeriod=120
Jul 18 01:50:38.295801 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:38.295721    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-web" containerID="cri-o://7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b" gracePeriod=120
Jul 18 01:50:38.295801 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:38.295733    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="config-reloader" containerID="cri-o://3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14" gracePeriod=120
Jul 18 01:50:38.295889 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:38.295792    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="prom-label-proxy" containerID="cri-o://cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a" gracePeriod=120
Jul 18 01:50:38.295889 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:38.295843    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy" containerID="cri-o://2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95" gracePeriod=120
Jul 18 01:50:39.271281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271248    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6265133-1d2b-4785-959e-8afe1b78325a" containerID="cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a" exitCode=0
Jul 18 01:50:39.271281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271275    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6265133-1d2b-4785-959e-8afe1b78325a" containerID="2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95" exitCode=0
Jul 18 01:50:39.271281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271282    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6265133-1d2b-4785-959e-8afe1b78325a" containerID="3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14" exitCode=0
Jul 18 01:50:39.271281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271287    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6265133-1d2b-4785-959e-8afe1b78325a" containerID="d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54" exitCode=0
Jul 18 01:50:39.271797 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"}
Jul 18 01:50:39.271797 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"}
Jul 18 01:50:39.271797 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"}
Jul 18 01:50:39.271797 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.271469    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"}
Jul 18 01:50:39.540817 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.540788    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:39.634729 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-config-out\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634729 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634735    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-metrics-client-ca\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-web\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634804    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634827    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634858    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-tls-assets\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634888    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc8nq\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-kube-api-access-zc8nq\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634931    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-main-db\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.634983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.634963    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-cluster-tls-config\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.635365 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.635002    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-web-config\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.635365 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.635032    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.635365 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.635067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-config-volume\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.635365 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.635130    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e6265133-1d2b-4785-959e-8afe1b78325a\" (UID: \"e6265133-1d2b-4785-959e-8afe1b78325a\") "
Jul 18 01:50:39.635365 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.635244    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:39.635630 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.635520    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-metrics-client-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.636455 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.636275    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:50:39.636455 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.636311    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:39.638439 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.638249    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:50:39.638439 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.638349    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-config-volume" (OuterVolumeSpecName: "config-volume") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:39.638652 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.638625    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:39.638745 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.638720    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-kube-api-access-zc8nq" (OuterVolumeSpecName: "kube-api-access-zc8nq") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "kube-api-access-zc8nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:50:39.638805 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.638746    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:39.638864 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.638846    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:39.638944 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.638924    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:39.639472 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.639450    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-config-out" (OuterVolumeSpecName: "config-out") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:50:39.643831 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.643748    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:39.651633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.651600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-web-config" (OuterVolumeSpecName: "web-config") pod "e6265133-1d2b-4785-959e-8afe1b78325a" (UID: "e6265133-1d2b-4785-959e-8afe1b78325a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:39.736159 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736116    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-config-volume\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736159 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736154    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736159 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736166    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-config-out\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736178    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736193    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-main-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736206    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736216    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-tls-assets\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736228    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc8nq\" (UniqueName: \"kubernetes.io/projected/e6265133-1d2b-4785-959e-8afe1b78325a-kube-api-access-zc8nq\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736239    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-main-db\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736250    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-cluster-tls-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736260    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6265133-1d2b-4785-959e-8afe1b78325a-web-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:39.736477 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:39.736272    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6265133-1d2b-4785-959e-8afe1b78325a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:40.278063 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.278028    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6265133-1d2b-4785-959e-8afe1b78325a" containerID="794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62" exitCode=0
Jul 18 01:50:40.278063 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.278053    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6265133-1d2b-4785-959e-8afe1b78325a" containerID="7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b" exitCode=0
Jul 18 01:50:40.278599 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.278105    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.278599 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.278105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"}
Jul 18 01:50:40.278599 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.278204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"}
Jul 18 01:50:40.278599 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.278248    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6265133-1d2b-4785-959e-8afe1b78325a","Type":"ContainerDied","Data":"3cbe5a2a12a63ed94ae5dbebf7947178f8c9f31c5a06850acd2c3ff29c89a8cd"}
Jul 18 01:50:40.278599 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.278263    2562 scope.go:117] "RemoveContainer" containerID="cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"
Jul 18 01:50:40.291718 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.291696    2562 scope.go:117] "RemoveContainer" containerID="794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"
Jul 18 01:50:40.302488 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.302458    2562 scope.go:117] "RemoveContainer" containerID="2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"
Jul 18 01:50:40.305633 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.305598    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:50:40.308946 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.308917    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:50:40.317221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.317202    2562 scope.go:117] "RemoveContainer" containerID="7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"
Jul 18 01:50:40.325838 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.325815    2562 scope.go:117] "RemoveContainer" containerID="3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"
Jul 18 01:50:40.333091 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333066    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:50:40.333493 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333477    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy"
Jul 18 01:50:40.333493 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333495    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333506    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="alertmanager"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333511    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="alertmanager"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333528    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67ff44d-b285-4705-b580-8903d971117c" containerName="console"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333533    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67ff44d-b285-4705-b580-8903d971117c" containerName="console"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333540    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="prom-label-proxy"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333546    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="prom-label-proxy"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333553    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c250d2c4-a49f-40e2-95d4-52d478e5a119" containerName="console"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333558    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c250d2c4-a49f-40e2-95d4-52d478e5a119" containerName="console"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333566    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="config-reloader"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333572    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="config-reloader"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333581    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-web"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333587    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-web"
Jul 18 01:50:40.333587 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333593    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-metric"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333598    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-metric"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333605    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="init-config-reloader"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333609    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="init-config-reloader"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333662    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-web"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333670    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy-metric"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333677    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="alertmanager"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333683    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="prom-label-proxy"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333690    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c250d2c4-a49f-40e2-95d4-52d478e5a119" containerName="console"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333695    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="config-reloader"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333701    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67ff44d-b285-4705-b580-8903d971117c" containerName="console"
Jul 18 01:50:40.334049 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.333706    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" containerName="kube-rbac-proxy"
Jul 18 01:50:40.334510 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.334371    2562 scope.go:117] "RemoveContainer" containerID="d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"
Jul 18 01:50:40.337354 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.337333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.339533 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.339483    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 18 01:50:40.339662 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.339571    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 18 01:50:40.339662 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.339575    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 18 01:50:40.339889 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.339873    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 18 01:50:40.339967 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.339890    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 18 01:50:40.340025 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.340010    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 18 01:50:40.340111 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.340096    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qrm7f\""
Jul 18 01:50:40.340369 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.340351    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 18 01:50:40.340512 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.340492    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 18 01:50:40.345476 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.345450    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 18 01:50:40.346191 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.346132    2562 scope.go:117] "RemoveContainer" containerID="af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda"
Jul 18 01:50:40.353417 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.353387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:50:40.355194 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.355169    2562 scope.go:117] "RemoveContainer" containerID="cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"
Jul 18 01:50:40.355572 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:40.355551    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a\": container with ID starting with cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a not found: ID does not exist" containerID="cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"
Jul 18 01:50:40.355652 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.355582    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"} err="failed to get container status \"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a\": rpc error: code = NotFound desc = could not find container \"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a\": container with ID starting with cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a not found: ID does not exist"
Jul 18 01:50:40.355652 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.355603    2562 scope.go:117] "RemoveContainer" containerID="794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"
Jul 18 01:50:40.355922 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:40.355907    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62\": container with ID starting with 794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62 not found: ID does not exist" containerID="794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"
Jul 18 01:50:40.355966 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.355928    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"} err="failed to get container status \"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62\": rpc error: code = NotFound desc = could not find container \"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62\": container with ID starting with 794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62 not found: ID does not exist"
Jul 18 01:50:40.355966 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.355944    2562 scope.go:117] "RemoveContainer" containerID="2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"
Jul 18 01:50:40.356237 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:40.356216    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95\": container with ID starting with 2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95 not found: ID does not exist" containerID="2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"
Jul 18 01:50:40.356308 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.356253    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"} err="failed to get container status \"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95\": rpc error: code = NotFound desc = could not find container \"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95\": container with ID starting with 2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95 not found: ID does not exist"
Jul 18 01:50:40.356308 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.356276    2562 scope.go:117] "RemoveContainer" containerID="7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"
Jul 18 01:50:40.356597 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:40.356579    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b\": container with ID starting with 7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b not found: ID does not exist" containerID="7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"
Jul 18 01:50:40.356662 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.356605    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"} err="failed to get container status \"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b\": rpc error: code = NotFound desc = could not find container \"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b\": container with ID starting with 7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b not found: ID does not exist"
Jul 18 01:50:40.356662 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.356626    2562 scope.go:117] "RemoveContainer" containerID="3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"
Jul 18 01:50:40.356857 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:40.356836    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14\": container with ID starting with 3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14 not found: ID does not exist" containerID="3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"
Jul 18 01:50:40.356940 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.356858    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"} err="failed to get container status \"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14\": rpc error: code = NotFound desc = could not find container \"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14\": container with ID starting with 3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14 not found: ID does not exist"
Jul 18 01:50:40.356940 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.356873    2562 scope.go:117] "RemoveContainer" containerID="d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"
Jul 18 01:50:40.357111 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:40.357091    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54\": container with ID starting with d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54 not found: ID does not exist" containerID="d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"
Jul 18 01:50:40.357150 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357117    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"} err="failed to get container status \"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54\": rpc error: code = NotFound desc = could not find container \"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54\": container with ID starting with d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54 not found: ID does not exist"
Jul 18 01:50:40.357150 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357140    2562 scope.go:117] "RemoveContainer" containerID="af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda"
Jul 18 01:50:40.357438 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:40.357416    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda\": container with ID starting with af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda not found: ID does not exist" containerID="af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda"
Jul 18 01:50:40.357505 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357444    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda"} err="failed to get container status \"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda\": rpc error: code = NotFound desc = could not find container \"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda\": container with ID starting with af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda not found: ID does not exist"
Jul 18 01:50:40.357505 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357464    2562 scope.go:117] "RemoveContainer" containerID="cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"
Jul 18 01:50:40.357712 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357690    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a"} err="failed to get container status \"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a\": rpc error: code = NotFound desc = could not find container \"cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a\": container with ID starting with cfa945a49d8096e9bb58ee4c0c90c73980af1a228a8fa31d166158c03e2b561a not found: ID does not exist"
Jul 18 01:50:40.357712 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357712    2562 scope.go:117] "RemoveContainer" containerID="794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"
Jul 18 01:50:40.357991 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357972    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62"} err="failed to get container status \"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62\": rpc error: code = NotFound desc = could not find container \"794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62\": container with ID starting with 794ec26247fac2558f89d23a12ec6858e24bab961a2853f63eed9310a0d8ed62 not found: ID does not exist"
Jul 18 01:50:40.358030 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.357993    2562 scope.go:117] "RemoveContainer" containerID="2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"
Jul 18 01:50:40.358194 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358175    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95"} err="failed to get container status \"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95\": rpc error: code = NotFound desc = could not find container \"2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95\": container with ID starting with 2a3efe8a5d6dff505fd8d1a019316c03f9ef7e3cf3cd74efc811b1c39f49ef95 not found: ID does not exist"
Jul 18 01:50:40.358246 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358193    2562 scope.go:117] "RemoveContainer" containerID="7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"
Jul 18 01:50:40.358427 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358407    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b"} err="failed to get container status \"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b\": rpc error: code = NotFound desc = could not find container \"7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b\": container with ID starting with 7b1daba0e43431a53c220114089475121f0e6acb5bbfd9a5296c31a89fafbb5b not found: ID does not exist"
Jul 18 01:50:40.358484 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358426    2562 scope.go:117] "RemoveContainer" containerID="3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"
Jul 18 01:50:40.358641 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358624    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14"} err="failed to get container status \"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14\": rpc error: code = NotFound desc = could not find container \"3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14\": container with ID starting with 3fdd5095655147da714cf0aeb040cafeb2a1024d4322734146003b827c82cb14 not found: ID does not exist"
Jul 18 01:50:40.358690 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358642    2562 scope.go:117] "RemoveContainer" containerID="d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"
Jul 18 01:50:40.358883 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358869    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54"} err="failed to get container status \"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54\": rpc error: code = NotFound desc = could not find container \"d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54\": container with ID starting with d38b20cd3fcc7041cff979d4e66e88e15544735ddae84529cc59bfb7e6d63d54 not found: ID does not exist"
Jul 18 01:50:40.358928 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.358883    2562 scope.go:117] "RemoveContainer" containerID="af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda"
Jul 18 01:50:40.359097 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.359082    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda"} err="failed to get container status \"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda\": rpc error: code = NotFound desc = could not find container \"af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda\": container with ID starting with af38de436cb0bdd786e7d128e8a05bc356e49b82d356d1b1110724dd14277bda not found: ID does not exist"
Jul 18 01:50:40.442015 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.441967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442015 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-web-config\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvw4\" (UniqueName: \"kubernetes.io/projected/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-kube-api-access-6kvw4\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-config-out\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.442677 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.442381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.529751 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.529667    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6265133-1d2b-4785-959e-8afe1b78325a" path="/var/lib/kubelet/pods/e6265133-1d2b-4785-959e-8afe1b78325a/volumes"
Jul 18 01:50:40.542926 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.542890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543036 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.542930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543036 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.542955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-config-out\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543181 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543252 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543252 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543397 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543397 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543397 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543397 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543602 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543602 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-web-config\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543602 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvw4\" (UniqueName: \"kubernetes.io/projected/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-kube-api-access-6kvw4\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.543602 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.543572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.544438 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.544411    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546272 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546272 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546472 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-config-out\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546617 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546585    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546903 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546883    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.546983 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.546962    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.547189 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.547172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-web-config\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.548303 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.548284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.551389 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.551364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvw4\" (UniqueName: \"kubernetes.io/projected/b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6-kube-api-access-6kvw4\") pod \"alertmanager-main-0\" (UID: \"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.649340 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.649297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 01:50:40.788713 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:40.788632    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 01:50:40.792230 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:50:40.792195    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3287c97_4dc9_46e8_ad9f_6e894cd4b8b6.slice/crio-afe2ff7c5787964135676d2c2222e1bf5c80ea245598926f47eb4685f2c9f4fe WatchSource:0}: Error finding container afe2ff7c5787964135676d2c2222e1bf5c80ea245598926f47eb4685f2c9f4fe: Status 404 returned error can't find the container with id afe2ff7c5787964135676d2c2222e1bf5c80ea245598926f47eb4685f2c9f4fe
Jul 18 01:50:41.284692 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:41.284656    2562 generic.go:356] "Generic (PLEG): container finished" podID="b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6" containerID="88846eaedccedce5c87dcd43a9db1d45157c6fa979e029ea772badc28418cffe" exitCode=0
Jul 18 01:50:41.285069 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:41.284713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerDied","Data":"88846eaedccedce5c87dcd43a9db1d45157c6fa979e029ea772badc28418cffe"}
Jul 18 01:50:41.285069 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:41.284764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerStarted","Data":"afe2ff7c5787964135676d2c2222e1bf5c80ea245598926f47eb4685f2c9f4fe"}
Jul 18 01:50:42.292294 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.292257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerStarted","Data":"64388072f3447c4bf7e9e451fcd64eff2983d82680150924a3e0202bcf2cd61e"}
Jul 18 01:50:42.292738 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.292386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerStarted","Data":"814a7b39ea0df02fd793c2c7644f1ab817f154dc25d2d37245273632d5ff244d"}
Jul 18 01:50:42.292738 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.292431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerStarted","Data":"7f9f521bbffc2f8214f59466e32573c73050dee39a1eaee46dcfbebfc1d4ef38"}
Jul 18 01:50:42.292738 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.292478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerStarted","Data":"6c8f2c71c04c0cd075bb93be8f8796ef50b06fe88d07aa062c7d7ff3c80bd81a"}
Jul 18 01:50:42.292738 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.292512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerStarted","Data":"59fd036405e667f1f7d681e6109b0a6df085c12896bb655c0d9f2d8a212f78d6"}
Jul 18 01:50:42.292738 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.292550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6","Type":"ContainerStarted","Data":"2d14a4eb58b5572b0a9eb93eb72ae2b810e649c0fa2eeaa447436c0b994bb897"}
Jul 18 01:50:42.317164 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.317091    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.301078371 podStartE2EDuration="2.317067892s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.989521ms" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:50:42.31522271 +0000 UTC m=+149.714622399" watchObservedRunningTime="2026-07-18 01:50:42.317067892 +0000 UTC m=+149.716467553"
Jul 18 01:50:42.532388 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.532354    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:50:42.532951 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.532917    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="prometheus" containerID="cri-o://f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a" gracePeriod=600
Jul 18 01:50:42.533499 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.533130    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-thanos" containerID="cri-o://32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1" gracePeriod=600
Jul 18 01:50:42.533591 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.533164    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-web" containerID="cri-o://8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387" gracePeriod=600
Jul 18 01:50:42.533648 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.533195    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy" containerID="cri-o://23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed" gracePeriod=600
Jul 18 01:50:42.533707 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.533192    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="thanos-sidecar" containerID="cri-o://fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0" gracePeriod=600
Jul 18 01:50:42.533761 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:42.533211    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="config-reloader" containerID="cri-o://3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52" gracePeriod=600
Jul 18 01:50:43.300785 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300749    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerID="32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1" exitCode=0
Jul 18 01:50:43.300785 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300777    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerID="23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed" exitCode=0
Jul 18 01:50:43.300785 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300786    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerID="fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0" exitCode=0
Jul 18 01:50:43.300785 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300793    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerID="3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52" exitCode=0
Jul 18 01:50:43.301464 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300800    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerID="f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a" exitCode=0
Jul 18 01:50:43.301464 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1"}
Jul 18 01:50:43.301464 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed"}
Jul 18 01:50:43.301464 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0"}
Jul 18 01:50:43.301464 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52"}
Jul 18 01:50:43.301464 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.300983    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a"}
Jul 18 01:50:43.780837 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.780812    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:43.874551 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874459    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-1\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874551 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874501    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-0\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874551 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874522    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgxtm\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-kube-api-access-kgxtm\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874551 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874544    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-config\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874593    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-db\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874630    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-tls\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874674    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-2\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874700    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-thanos-prometheus-http-client-file\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874735    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-grpc-tls\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874782    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-tls-assets\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874809    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-kubelet-serving-ca-bundle\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874833    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-config-out\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.874860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874862    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-metrics-client-certs\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874886    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-serving-certs-ca-bundle\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874906    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874920    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-trusted-ca-bundle\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.874987    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-metrics-client-ca\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875042    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-web-config\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875078    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-kube-rbac-proxy\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875110    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c133546c-fe4a-4f90-a2c4-261b70959a65\" (UID: \"c133546c-fe4a-4f90-a2c4-261b70959a65\") "
Jul 18 01:50:43.875315 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875252    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:43.875689 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875447    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.875689 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875466    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.875780 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875753    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:43.875947 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.875914    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:50:43.877931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.876952    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:43.877931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.877342    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:43.877931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.877893    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:43.877931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.877900    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:50:43.878311 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.878268    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-config" (OuterVolumeSpecName: "config") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.878678 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.878652    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.878925 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.878901    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.878925 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.878920    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-kube-api-access-kgxtm" (OuterVolumeSpecName: "kube-api-access-kgxtm") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "kube-api-access-kgxtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:50:43.879083 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.879003    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-config-out" (OuterVolumeSpecName: "config-out") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:50:43.879162 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.879143    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.879529 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.879510    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:50:43.879665 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.879650    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.880103 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.880074    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.880285 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.880262    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.880549 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.880525    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.891751 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.891704    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-web-config" (OuterVolumeSpecName: "web-config") pod "c133546c-fe4a-4f90-a2c4-261b70959a65" (UID: "c133546c-fe4a-4f90-a2c4-261b70959a65"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:50:43.976515 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976476    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976515 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976505    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976515 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976518    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-grpc-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976515 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976527    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-tls-assets\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976537    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976545    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-config-out\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976556    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-metrics-client-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976564    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976573    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-configmap-metrics-client-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976581    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-web-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976590    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-kube-rbac-proxy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976598    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976608    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976616    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgxtm\" (UniqueName: \"kubernetes.io/projected/c133546c-fe4a-4f90-a2c4-261b70959a65-kube-api-access-kgxtm\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976625    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976633    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-config\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976641    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c133546c-fe4a-4f90-a2c4-261b70959a65-prometheus-k8s-db\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:43.976783 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:43.976650    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c133546c-fe4a-4f90-a2c4-261b70959a65-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:50:44.308605 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.308573    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerID="8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387" exitCode=0
Jul 18 01:50:44.308962 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.308656    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.308962 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.308651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387"}
Jul 18 01:50:44.308962 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.308728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c133546c-fe4a-4f90-a2c4-261b70959a65","Type":"ContainerDied","Data":"e08f097dbd8164cd59eedcdc515be939d30c0f9cb1be7530c3ffd7a0776a3143"}
Jul 18 01:50:44.308962 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.308768    2562 scope.go:117] "RemoveContainer" containerID="32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1"
Jul 18 01:50:44.320748 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.320720    2562 scope.go:117] "RemoveContainer" containerID="23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed"
Jul 18 01:50:44.329589 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.329567    2562 scope.go:117] "RemoveContainer" containerID="8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387"
Jul 18 01:50:44.337455 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.337429    2562 scope.go:117] "RemoveContainer" containerID="fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0"
Jul 18 01:50:44.338478 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.338393    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:50:44.342433 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.342408    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:50:44.345201 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.345181    2562 scope.go:117] "RemoveContainer" containerID="3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52"
Jul 18 01:50:44.352344 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.352308    2562 scope.go:117] "RemoveContainer" containerID="f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a"
Jul 18 01:50:44.360188 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.360171    2562 scope.go:117] "RemoveContainer" containerID="23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6"
Jul 18 01:50:44.367536 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.367512    2562 scope.go:117] "RemoveContainer" containerID="32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1"
Jul 18 01:50:44.367847 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:44.367827    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1\": container with ID starting with 32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1 not found: ID does not exist" containerID="32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1"
Jul 18 01:50:44.367907 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.367858    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1"} err="failed to get container status \"32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1\": rpc error: code = NotFound desc = could not find container \"32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1\": container with ID starting with 32adc1ff93c111511ffeca7b7c69f5f75e7bc11b15139da8dd354b4ef2042aa1 not found: ID does not exist"
Jul 18 01:50:44.367907 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.367878    2562 scope.go:117] "RemoveContainer" containerID="23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed"
Jul 18 01:50:44.368172 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:44.368150    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed\": container with ID starting with 23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed not found: ID does not exist" containerID="23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed"
Jul 18 01:50:44.368246 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.368183    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed"} err="failed to get container status \"23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed\": rpc error: code = NotFound desc = could not find container \"23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed\": container with ID starting with 23e0c35bb59341ab08184966fa0b80e93603a753c2805999f604c418d60a9fed not found: ID does not exist"
Jul 18 01:50:44.368246 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.368209    2562 scope.go:117] "RemoveContainer" containerID="8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387"
Jul 18 01:50:44.368474 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:44.368449    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387\": container with ID starting with 8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387 not found: ID does not exist" containerID="8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387"
Jul 18 01:50:44.368534 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.368478    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387"} err="failed to get container status \"8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387\": rpc error: code = NotFound desc = could not find container \"8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387\": container with ID starting with 8e604b57880e00de7d334f3928757603473c835c2565a5e6856fe3be48feb387 not found: ID does not exist"
Jul 18 01:50:44.368534 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.368498    2562 scope.go:117] "RemoveContainer" containerID="fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0"
Jul 18 01:50:44.368734 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:44.368717    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0\": container with ID starting with fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0 not found: ID does not exist" containerID="fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0"
Jul 18 01:50:44.368796 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.368744    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0"} err="failed to get container status \"fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0\": rpc error: code = NotFound desc = could not find container \"fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0\": container with ID starting with fae69d39d9ff7b99037ef7fad4ae27c5334a147b9c71d717ca61ee5a86f28bd0 not found: ID does not exist"
Jul 18 01:50:44.368796 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.368767    2562 scope.go:117] "RemoveContainer" containerID="3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52"
Jul 18 01:50:44.369007 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:44.368986    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52\": container with ID starting with 3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52 not found: ID does not exist" containerID="3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52"
Jul 18 01:50:44.369041 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.369011    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52"} err="failed to get container status \"3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52\": rpc error: code = NotFound desc = could not find container \"3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52\": container with ID starting with 3da797e9b2580fcd83f87fbad50533f7e3f0b440b29059ac7df46620763e8a52 not found: ID does not exist"
Jul 18 01:50:44.369041 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.369025    2562 scope.go:117] "RemoveContainer" containerID="f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a"
Jul 18 01:50:44.369250 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:44.369232    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a\": container with ID starting with f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a not found: ID does not exist" containerID="f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a"
Jul 18 01:50:44.369294 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.369254    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a"} err="failed to get container status \"f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a\": rpc error: code = NotFound desc = could not find container \"f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a\": container with ID starting with f3a96a8270af2a2552f7d00ad6404174aab580aca8a4315fc63f20b97ed25b4a not found: ID does not exist"
Jul 18 01:50:44.369294 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.369268    2562 scope.go:117] "RemoveContainer" containerID="23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6"
Jul 18 01:50:44.369538 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:50:44.369515    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6\": container with ID starting with 23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6 not found: ID does not exist" containerID="23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6"
Jul 18 01:50:44.369616 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.369543    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6"} err="failed to get container status \"23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6\": rpc error: code = NotFound desc = could not find container \"23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6\": container with ID starting with 23bdf636d42c3476fe6c055755ce6f5ac880c5f07153447ce96c9a4903a88ad6 not found: ID does not exist"
Jul 18 01:50:44.375181 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375156    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:50:44.375514 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375500    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="prometheus"
Jul 18 01:50:44.375562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375516    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="prometheus"
Jul 18 01:50:44.375562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375526    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="init-config-reloader"
Jul 18 01:50:44.375562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375533    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="init-config-reloader"
Jul 18 01:50:44.375562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375541    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="config-reloader"
Jul 18 01:50:44.375562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375546    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="config-reloader"
Jul 18 01:50:44.375562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375555    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-thanos"
Jul 18 01:50:44.375562 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375561    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-thanos"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375568    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375574    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375581    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="thanos-sidecar"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375586    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="thanos-sidecar"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375603    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-web"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375609    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-web"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375648    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="prometheus"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375655    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-thanos"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375664    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="thanos-sidecar"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375670    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="config-reloader"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375675    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy"
Jul 18 01:50:44.375762 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.375681    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" containerName="kube-rbac-proxy-web"
Jul 18 01:50:44.379917 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.379897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.382203 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.382180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 01:50:44.382360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.382220    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 01:50:44.382360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.382180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h8sbn\""
Jul 18 01:50:44.382568 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.382528    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 01:50:44.382698 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.382665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 01:50:44.382768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.382667    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-80b7if4l41hj1\""
Jul 18 01:50:44.382832 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.382794    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 01:50:44.383059 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383039    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 01:50:44.383168 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383050    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 01:50:44.383168 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383097    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 01:50:44.383281 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383212    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 01:50:44.383381 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383285    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 01:50:44.383453 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383439    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 01:50:44.383638 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383622    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 01:50:44.383690 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.383629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 01:50:44.386231 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.386213    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 01:50:44.388997 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.388975    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 01:50:44.400215 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.400185    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:50:44.480341 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480541 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480541 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480541 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480541 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480541 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a964985-149a-484b-8ec1-b0996f32fac1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480802 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480802 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4rf8\" (UniqueName: \"kubernetes.io/projected/5a964985-149a-484b-8ec1-b0996f32fac1-kube-api-access-k4rf8\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480802 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a964985-149a-484b-8ec1-b0996f32fac1-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480802 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480683    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480802 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-config\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480802 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.480802 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.481107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.481107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.481107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.481107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.481107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.481107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.481107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.480998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.529963 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.529928    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c133546c-fe4a-4f90-a2c4-261b70959a65" path="/var/lib/kubelet/pods/c133546c-fe4a-4f90-a2c4-261b70959a65/volumes"
Jul 18 01:50:44.582513 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582513 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582513 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a964985-149a-484b-8ec1-b0996f32fac1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4rf8\" (UniqueName: \"kubernetes.io/projected/5a964985-149a-484b-8ec1-b0996f32fac1-kube-api-access-k4rf8\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a964985-149a-484b-8ec1-b0996f32fac1-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-config\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.582750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.582992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.583227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.583258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.583608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.583261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.584104 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.584075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.584710 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.584680    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.585365 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.585341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.586192 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.585790    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.586192 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.585904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.586192 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.586106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a964985-149a-484b-8ec1-b0996f32fac1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.586415 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.586230    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.586415 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.586311    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.586415 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.586350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.586592 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.586566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.587550 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.587531    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a964985-149a-484b-8ec1-b0996f32fac1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.587754 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.587738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.588040 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.588025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a964985-149a-484b-8ec1-b0996f32fac1-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.588450 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.588433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-config\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.588511 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.588494    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.588558 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.588543    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a964985-149a-484b-8ec1-b0996f32fac1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.590935 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.590918    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4rf8\" (UniqueName: \"kubernetes.io/projected/5a964985-149a-484b-8ec1-b0996f32fac1-kube-api-access-k4rf8\") pod \"prometheus-k8s-0\" (UID: \"5a964985-149a-484b-8ec1-b0996f32fac1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.690355 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.690310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:44.827836 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:44.827811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 01:50:44.830216 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:50:44.830188    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a964985_149a_484b_8ec1_b0996f32fac1.slice/crio-f941dffb13b2f8f0d09cb9da9291eb4631c766e1a2031dbdf62f443848b858fc WatchSource:0}: Error finding container f941dffb13b2f8f0d09cb9da9291eb4631c766e1a2031dbdf62f443848b858fc: Status 404 returned error can't find the container with id f941dffb13b2f8f0d09cb9da9291eb4631c766e1a2031dbdf62f443848b858fc
Jul 18 01:50:45.315037 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:45.315001    2562 generic.go:356] "Generic (PLEG): container finished" podID="5a964985-149a-484b-8ec1-b0996f32fac1" containerID="ddb7590d333d24e0231604ed1da2d0afbb5f79586b79fca5220540503b4963fb" exitCode=0
Jul 18 01:50:45.315462 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:45.315071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerDied","Data":"ddb7590d333d24e0231604ed1da2d0afbb5f79586b79fca5220540503b4963fb"}
Jul 18 01:50:45.315462 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:45.315121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerStarted","Data":"f941dffb13b2f8f0d09cb9da9291eb4631c766e1a2031dbdf62f443848b858fc"}
Jul 18 01:50:46.111244 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.111212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:46.166637 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.166605    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:46.322596 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.322562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerStarted","Data":"9c5b0bb3831cd0b4e8dc547de929432da84ece13be8d301aea57b2acb01ee419"}
Jul 18 01:50:46.322997 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.322626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerStarted","Data":"44b7eaee8a9eb88e1aab870ba745339f743cd68607bbc536e163b89d0107192b"}
Jul 18 01:50:46.322997 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.322653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerStarted","Data":"ae68f509b5a7b2521099cba690be86fda2d63bb511fa0e8d2d59987fd75bcb83"}
Jul 18 01:50:46.322997 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.322675    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerStarted","Data":"16182dea0492125bd5b5bf2f6239399e935bcc21300d6a3e3bd518d68a112d0f"}
Jul 18 01:50:46.322997 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.322697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerStarted","Data":"40c44923067fb64b4571dba5009ea742fba2d49c33e278d27bdc17107cb65034"}
Jul 18 01:50:46.322997 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.322721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a964985-149a-484b-8ec1-b0996f32fac1","Type":"ContainerStarted","Data":"9656a3875cb689654918c2e44f82fa4056df3b5dd3192d341b2e25e8274b0610"}
Jul 18 01:50:46.350621 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:46.350566    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.331735019 podStartE2EDuration="2.350544871s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.809852ms" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:50:46.347518008 +0000 UTC m=+153.746917667" watchObservedRunningTime="2026-07-18 01:50:46.350544871 +0000 UTC m=+153.749944530"
Jul 18 01:50:49.033547 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:49.033508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:49.134115 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:49.134079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:49.187986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:49.187959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:49.690701 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:49.690659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:50:50.269261 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:50.269223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:50.369569 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:50.369537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:51.656798 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:51.656753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:50:51.748471 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:50:51.748430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:08.745706 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:08.745607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:08.848211 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:08.848156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:08.908599 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:08.908564    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:30.814518 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:30.814484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:30.910119 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:30.910085    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:37.513675 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:37.513644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:37.573737 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:37.573703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:44.690730 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:44.690700    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:51:44.705875 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:44.705848    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:51:45.578538 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:45.578505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 01:51:57.445902 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:57.445863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:51:58.237536 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:51:58.237501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:01.042592 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:01.042552    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:01.143583 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:01.143550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:01.259385 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:01.259352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:01.331748 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:01.331661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:02.207113 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:02.207075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:02.298577 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:02.298544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:03.105835 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:03.105804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:03.186701 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:03.186666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:05.101436 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.101407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:05.394169 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.394092    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkck5"]
Jul 18 01:52:05.397246 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.397230    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.399469 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.399446    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 18 01:52:05.400157 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.400141    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 18 01:52:05.400211 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.400143    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7gfwp\""
Jul 18 01:52:05.405646 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.405625    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkck5"]
Jul 18 01:52:05.481919 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.481885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bbacfda-415f-4a8e-9525-c46d097adc34-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkck5\" (UID: \"3bbacfda-415f-4a8e-9525-c46d097adc34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.482083 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.481934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgpc\" (UniqueName: \"kubernetes.io/projected/3bbacfda-415f-4a8e-9525-c46d097adc34-kube-api-access-zbgpc\") pod \"cert-manager-webhook-6486ffd997-vkck5\" (UID: \"3bbacfda-415f-4a8e-9525-c46d097adc34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.498781 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.498757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:05.582641 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.582606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bbacfda-415f-4a8e-9525-c46d097adc34-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkck5\" (UID: \"3bbacfda-415f-4a8e-9525-c46d097adc34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.582843 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.582664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgpc\" (UniqueName: \"kubernetes.io/projected/3bbacfda-415f-4a8e-9525-c46d097adc34-kube-api-access-zbgpc\") pod \"cert-manager-webhook-6486ffd997-vkck5\" (UID: \"3bbacfda-415f-4a8e-9525-c46d097adc34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.590307 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.590279    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3bbacfda-415f-4a8e-9525-c46d097adc34-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vkck5\" (UID: \"3bbacfda-415f-4a8e-9525-c46d097adc34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.590462 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.590371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgpc\" (UniqueName: \"kubernetes.io/projected/3bbacfda-415f-4a8e-9525-c46d097adc34-kube-api-access-zbgpc\") pod \"cert-manager-webhook-6486ffd997-vkck5\" (UID: \"3bbacfda-415f-4a8e-9525-c46d097adc34\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.715107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.715021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:05.844419 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.844389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vkck5"]
Jul 18 01:52:05.847827 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:52:05.847786    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bbacfda_415f_4a8e_9525_c46d097adc34.slice/crio-d68b8e893441936c3bf023c897d0b595615ca6d235954f5dcce9c3524603402e WatchSource:0}: Error finding container d68b8e893441936c3bf023c897d0b595615ca6d235954f5dcce9c3524603402e: Status 404 returned error can't find the container with id d68b8e893441936c3bf023c897d0b595615ca6d235954f5dcce9c3524603402e
Jul 18 01:52:05.989812 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.989721    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"]
Jul 18 01:52:05.994113 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.994088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:05.996241 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:05.996221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jr2fn\""
Jul 18 01:52:06.002800 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.002771    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"]
Jul 18 01:52:06.088251 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.088209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ce5dcea-418d-4f93-abda-a4b710c5d398-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wkvz4\" (UID: \"0ce5dcea-418d-4f93-abda-a4b710c5d398\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:06.088456 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.088263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/0ce5dcea-418d-4f93-abda-a4b710c5d398-kube-api-access-8cxmk\") pod \"cert-manager-cainjector-559cdd8c87-wkvz4\" (UID: \"0ce5dcea-418d-4f93-abda-a4b710c5d398\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:06.189508 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.189465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ce5dcea-418d-4f93-abda-a4b710c5d398-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wkvz4\" (UID: \"0ce5dcea-418d-4f93-abda-a4b710c5d398\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:06.189937 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.189534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/0ce5dcea-418d-4f93-abda-a4b710c5d398-kube-api-access-8cxmk\") pod \"cert-manager-cainjector-559cdd8c87-wkvz4\" (UID: \"0ce5dcea-418d-4f93-abda-a4b710c5d398\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:06.197331 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.197300    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ce5dcea-418d-4f93-abda-a4b710c5d398-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wkvz4\" (UID: \"0ce5dcea-418d-4f93-abda-a4b710c5d398\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:06.197663 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.197644    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/0ce5dcea-418d-4f93-abda-a4b710c5d398-kube-api-access-8cxmk\") pod \"cert-manager-cainjector-559cdd8c87-wkvz4\" (UID: \"0ce5dcea-418d-4f93-abda-a4b710c5d398\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:06.303995 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.303961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"
Jul 18 01:52:06.435989 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.435813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4"]
Jul 18 01:52:06.438531 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:52:06.438508    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ce5dcea_418d_4f93_abda_a4b710c5d398.slice/crio-cb8ce1db71656e694f18bb8af8160ac34f8e7b628083b91ca6580c5a37a1929f WatchSource:0}: Error finding container cb8ce1db71656e694f18bb8af8160ac34f8e7b628083b91ca6580c5a37a1929f: Status 404 returned error can't find the container with id cb8ce1db71656e694f18bb8af8160ac34f8e7b628083b91ca6580c5a37a1929f
Jul 18 01:52:06.648575 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.648482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4" event={"ID":"0ce5dcea-418d-4f93-abda-a4b710c5d398","Type":"ContainerStarted","Data":"cb8ce1db71656e694f18bb8af8160ac34f8e7b628083b91ca6580c5a37a1929f"}
Jul 18 01:52:06.649606 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:06.649586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5" event={"ID":"3bbacfda-415f-4a8e-9525-c46d097adc34","Type":"ContainerStarted","Data":"d68b8e893441936c3bf023c897d0b595615ca6d235954f5dcce9c3524603402e"}
Jul 18 01:52:07.842448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:07.842407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:07.910711 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:07.910641    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:09.668382 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:09.668317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4" event={"ID":"0ce5dcea-418d-4f93-abda-a4b710c5d398","Type":"ContainerStarted","Data":"7dc9f8db4fdadf0634f31c327f10224d75dd1394e2e998976eeede431d5fa384"}
Jul 18 01:52:09.670019 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:09.669991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5" event={"ID":"3bbacfda-415f-4a8e-9525-c46d097adc34","Type":"ContainerStarted","Data":"2d56f557f3193831a340e76ad480f835d47bef9f09596fe8fcdfc677f40ddd99"}
Jul 18 01:52:09.670131 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:09.670061    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:09.684910 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:09.684801    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wkvz4" podStartSLOduration=1.679898342 podStartE2EDuration="4.684782617s" totalImagesPullingTime="3.004884275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:09.683411597 +0000 UTC m=+237.082811256" watchObservedRunningTime="2026-07-18 01:52:09.684782617 +0000 UTC m=+237.084182275"
Jul 18 01:52:10.238032 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:10.238004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:10.288776 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:10.288742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:13.699596 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:13.699563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:13.852833 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:13.852804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:13.951936 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:13.951857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:15.676749 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:15.676709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5"
Jul 18 01:52:15.696620 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:15.696567    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vkck5" podStartSLOduration=7.112066294 podStartE2EDuration="10.696550538s" totalImagesPullingTime="3.584484244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:09.701152614 +0000 UTC m=+237.100552277" watchObservedRunningTime="2026-07-18 01:52:15.696550538 +0000 UTC m=+243.095950196"
Jul 18 01:52:16.070198 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.070160    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"]
Jul 18 01:52:16.073761 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.073739    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.076033 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.076009    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tzr2g\""
Jul 18 01:52:16.076168 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.076010    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:52:16.076168 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.076017    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 18 01:52:16.081850 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.081829    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"]
Jul 18 01:52:16.182387 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.182354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0a7e9f-380f-41c6-b8e0-8eb510645abc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4wgqv\" (UID: \"aa0a7e9f-380f-41c6-b8e0-8eb510645abc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.182556 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.182430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5x7t\" (UniqueName: \"kubernetes.io/projected/aa0a7e9f-380f-41c6-b8e0-8eb510645abc-kube-api-access-b5x7t\") pod \"openshift-lws-operator-fd8ccff4c-4wgqv\" (UID: \"aa0a7e9f-380f-41c6-b8e0-8eb510645abc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.283488 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.283453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5x7t\" (UniqueName: \"kubernetes.io/projected/aa0a7e9f-380f-41c6-b8e0-8eb510645abc-kube-api-access-b5x7t\") pod \"openshift-lws-operator-fd8ccff4c-4wgqv\" (UID: \"aa0a7e9f-380f-41c6-b8e0-8eb510645abc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.283662 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.283523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0a7e9f-380f-41c6-b8e0-8eb510645abc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4wgqv\" (UID: \"aa0a7e9f-380f-41c6-b8e0-8eb510645abc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.283849 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.283833    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0a7e9f-380f-41c6-b8e0-8eb510645abc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4wgqv\" (UID: \"aa0a7e9f-380f-41c6-b8e0-8eb510645abc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.295418 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.295391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5x7t\" (UniqueName: \"kubernetes.io/projected/aa0a7e9f-380f-41c6-b8e0-8eb510645abc-kube-api-access-b5x7t\") pod \"openshift-lws-operator-fd8ccff4c-4wgqv\" (UID: \"aa0a7e9f-380f-41c6-b8e0-8eb510645abc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.384354 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.384268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"
Jul 18 01:52:16.522013 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.521978    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv"]
Jul 18 01:52:16.524898 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:52:16.524867    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa0a7e9f_380f_41c6_b8e0_8eb510645abc.slice/crio-5549b3ba2dd438890acc056f8007db2684df16e99ec28d4626b1e061d6aee30c WatchSource:0}: Error finding container 5549b3ba2dd438890acc056f8007db2684df16e99ec28d4626b1e061d6aee30c: Status 404 returned error can't find the container with id 5549b3ba2dd438890acc056f8007db2684df16e99ec28d4626b1e061d6aee30c
Jul 18 01:52:16.699665 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:16.699575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv" event={"ID":"aa0a7e9f-380f-41c6-b8e0-8eb510645abc","Type":"ContainerStarted","Data":"5549b3ba2dd438890acc056f8007db2684df16e99ec28d4626b1e061d6aee30c"}
Jul 18 01:52:19.715072 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:19.715037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv" event={"ID":"aa0a7e9f-380f-41c6-b8e0-8eb510645abc","Type":"ContainerStarted","Data":"c5cbcd0cd2e827794e2bf5a572b2023389c40692fd21f09963c460856453bc2a"}
Jul 18 01:52:19.730395 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:19.730318    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4wgqv" podStartSLOduration=1.4903790670000001 podStartE2EDuration="3.730300606s" totalImagesPullingTime="2.239921539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:19.729670747 +0000 UTC m=+247.129070409" watchObservedRunningTime="2026-07-18 01:52:19.730300606 +0000 UTC m=+247.129700265"
Jul 18 01:52:20.443275 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:20.443234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:20.544413 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:20.544375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:21.051919 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:21.051888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:22.388462 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:22.388419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:34.472173 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:34.472090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:34.567553 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:34.567515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.105120 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.105084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.316370 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.316307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.422143 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.422051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.462771 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.462734    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"]
Jul 18 01:52:35.465845 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.465821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.469097 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.469078    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 01:52:35.469426 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.469407    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 01:52:35.469717 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.469701    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 01:52:35.469790 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.469701    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8xwps\""
Jul 18 01:52:35.469829 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.469789    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 01:52:35.486304 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.486274    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"]
Jul 18 01:52:35.558151 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.558112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8bfc056-cc54-4080-a72d-2de3ddc268dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.558151 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.558158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8bfc056-cc54-4080-a72d-2de3ddc268dc-tmp\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.558407 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.558225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8bfc056-cc54-4080-a72d-2de3ddc268dc-manifests\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.558407 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.558292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7d2r\" (UniqueName: \"kubernetes.io/projected/a8bfc056-cc54-4080-a72d-2de3ddc268dc-kube-api-access-p7d2r\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.558407 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.558345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8bfc056-cc54-4080-a72d-2de3ddc268dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.594189 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.594132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.659448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.659414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8bfc056-cc54-4080-a72d-2de3ddc268dc-manifests\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.659608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.659457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7d2r\" (UniqueName: \"kubernetes.io/projected/a8bfc056-cc54-4080-a72d-2de3ddc268dc-kube-api-access-p7d2r\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.659608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.659479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8bfc056-cc54-4080-a72d-2de3ddc268dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.659608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.659541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8bfc056-cc54-4080-a72d-2de3ddc268dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.659608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.659569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8bfc056-cc54-4080-a72d-2de3ddc268dc-tmp\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.659907 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.659884    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8bfc056-cc54-4080-a72d-2de3ddc268dc-manifests\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.661968 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.661943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8bfc056-cc54-4080-a72d-2de3ddc268dc-tmp\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.662094 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.662024    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8bfc056-cc54-4080-a72d-2de3ddc268dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.662156 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.662132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8bfc056-cc54-4080-a72d-2de3ddc268dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.666706 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.666685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7d2r\" (UniqueName: \"kubernetes.io/projected/a8bfc056-cc54-4080-a72d-2de3ddc268dc-kube-api-access-p7d2r\") pod \"opendatahub-operator-controller-manager-6667d74d96-4pm7q\" (UID: \"a8bfc056-cc54-4080-a72d-2de3ddc268dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.694414 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.694349    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.775982 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.775953    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:35.807618 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.807581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.902891 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.902858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:35.916313 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.916279    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"]
Jul 18 01:52:35.920040 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:52:35.920011    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bfc056_cc54_4080_a72d_2de3ddc268dc.slice/crio-3b7a03b7df0a453136d88f0152bea1d83bb3ced19d5a1f435575ace0686629c7 WatchSource:0}: Error finding container 3b7a03b7df0a453136d88f0152bea1d83bb3ced19d5a1f435575ace0686629c7: Status 404 returned error can't find the container with id 3b7a03b7df0a453136d88f0152bea1d83bb3ced19d5a1f435575ace0686629c7
Jul 18 01:52:35.998046 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:35.997998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:36.100069 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:36.100037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:36.783706 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:36.783670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q" event={"ID":"a8bfc056-cc54-4080-a72d-2de3ddc268dc","Type":"ContainerStarted","Data":"3b7a03b7df0a453136d88f0152bea1d83bb3ced19d5a1f435575ace0686629c7"}
Jul 18 01:52:39.801423 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:39.801381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q" event={"ID":"a8bfc056-cc54-4080-a72d-2de3ddc268dc","Type":"ContainerStarted","Data":"9d631f17b8912314eba6f278f7c58be1164cd04551fb0b037e6e1ec61e763f9e"}
Jul 18 01:52:40.806944 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:40.806904    2562 generic.go:356] "Generic (PLEG): container finished" podID="a8bfc056-cc54-4080-a72d-2de3ddc268dc" containerID="9d631f17b8912314eba6f278f7c58be1164cd04551fb0b037e6e1ec61e763f9e" exitCode=0
Jul 18 01:52:40.807375 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:40.806986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q" event={"ID":"a8bfc056-cc54-4080-a72d-2de3ddc268dc","Type":"ContainerDied","Data":"9d631f17b8912314eba6f278f7c58be1164cd04551fb0b037e6e1ec61e763f9e"}
Jul 18 01:52:41.813758 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:41.813714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q" event={"ID":"a8bfc056-cc54-4080-a72d-2de3ddc268dc","Type":"ContainerStarted","Data":"1abfdf1da11ab57a1ec056d4b4af0ba1151962423e4818d8a6067ceda8862d1d"}
Jul 18 01:52:41.814130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:41.813869    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:41.838834 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:41.838781    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q" podStartSLOduration=2.433580193 podStartE2EDuration="6.838765002s" totalImagesPullingTime="3.358713841s" totalInitContainerRuntime="1.046470968s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:41.836734205 +0000 UTC m=+269.236133863" watchObservedRunningTime="2026-07-18 01:52:41.838765002 +0000 UTC m=+269.238164660"
Jul 18 01:52:52.820394 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:52.820359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6667d74d96-4pm7q"
Jul 18 01:52:54.017819 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.017786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:54.107224 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.107183    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"]
Jul 18 01:52:54.119780 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.119756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.124087 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.124064    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jkpsg\""
Jul 18 01:52:54.124845 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.124831    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 18 01:52:54.124931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.124863    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 18 01:52:54.124931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.124882    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 18 01:52:54.130047 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.130022    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"]
Jul 18 01:52:54.172238 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.172210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:54.217062 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.217034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3328d2b6-eb57-4990-b775-0a22a093e841-cert\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.217221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.217078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmv7\" (UniqueName: \"kubernetes.io/projected/3328d2b6-eb57-4990-b775-0a22a093e841-kube-api-access-drmv7\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.217221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.217121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3328d2b6-eb57-4990-b775-0a22a093e841-manager-config\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.217221 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.217165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3328d2b6-eb57-4990-b775-0a22a093e841-metrics-cert\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.317970 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.317889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3328d2b6-eb57-4990-b775-0a22a093e841-cert\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.317970 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.317929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmv7\" (UniqueName: \"kubernetes.io/projected/3328d2b6-eb57-4990-b775-0a22a093e841-kube-api-access-drmv7\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.317970 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.317956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3328d2b6-eb57-4990-b775-0a22a093e841-manager-config\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.318356 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.317993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3328d2b6-eb57-4990-b775-0a22a093e841-metrics-cert\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.318711 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.318687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3328d2b6-eb57-4990-b775-0a22a093e841-manager-config\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.320287 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.320257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3328d2b6-eb57-4990-b775-0a22a093e841-metrics-cert\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.320408 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.320386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3328d2b6-eb57-4990-b775-0a22a093e841-cert\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.332702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.332682    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmv7\" (UniqueName: \"kubernetes.io/projected/3328d2b6-eb57-4990-b775-0a22a093e841-kube-api-access-drmv7\") pod \"lws-controller-manager-5b6fc5d786-4smw6\" (UID: \"3328d2b6-eb57-4990-b775-0a22a093e841\") " pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.429479 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.429440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:54.607206 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.607125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:54.611158 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.611128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"]
Jul 18 01:52:54.614920 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:52:54.614886    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3328d2b6_eb57_4990_b775_0a22a093e841.slice/crio-a26c4ef344951110e6c756f9747b3e3e4ade64a0545d1e34edb14fba46d1d773 WatchSource:0}: Error finding container a26c4ef344951110e6c756f9747b3e3e4ade64a0545d1e34edb14fba46d1d773: Status 404 returned error can't find the container with id a26c4ef344951110e6c756f9747b3e3e4ade64a0545d1e34edb14fba46d1d773
Jul 18 01:52:54.776258 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.776222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:54.875295 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:54.875207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6" event={"ID":"3328d2b6-eb57-4990-b775-0a22a093e841","Type":"ContainerStarted","Data":"a26c4ef344951110e6c756f9747b3e3e4ade64a0545d1e34edb14fba46d1d773"}
Jul 18 01:52:55.238742 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.238656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:55.274237 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.274199    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"]
Jul 18 01:52:55.278107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.278078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.284338 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.284233    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 01:52:55.284900 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.284876    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 01:52:55.285224 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.285055    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 01:52:55.285224 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.285109    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dpdcv\""
Jul 18 01:52:55.285413 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.285402    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 01:52:55.291748 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.291727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"]
Jul 18 01:52:55.328057 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.328026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tmp\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.328237 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.328139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tls-certs\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.328237 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.328171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zvzl\" (UniqueName: \"kubernetes.io/projected/a5517401-298d-4bc1-8bda-ae8d0ae920eb-kube-api-access-6zvzl\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.429778 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.429722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tmp\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.429951 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.429859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tls-certs\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.429951 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.429885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zvzl\" (UniqueName: \"kubernetes.io/projected/a5517401-298d-4bc1-8bda-ae8d0ae920eb-kube-api-access-6zvzl\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.430139 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:52:55.430102    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 18 01:52:55.430725 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:52:55.430186    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tls-certs podName:a5517401-298d-4bc1-8bda-ae8d0ae920eb nodeName:}" failed. No retries permitted until 2026-07-18 01:52:55.930159539 +0000 UTC m=+283.329559192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tls-certs") pod "kube-auth-proxy-7c44dbb944-n2jcl" (UID: "a5517401-298d-4bc1-8bda-ae8d0ae920eb") : secret "kube-auth-proxy-tls" not found
Jul 18 01:52:55.432250 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.432226    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tmp\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.454862 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.454837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zvzl\" (UniqueName: \"kubernetes.io/projected/a5517401-298d-4bc1-8bda-ae8d0ae920eb-kube-api-access-6zvzl\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.568451 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.568417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:55.745407 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.745365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:55.905354 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.905255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:55.936593 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.936555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tls-certs\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:55.939813 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:55.939780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5517401-298d-4bc1-8bda-ae8d0ae920eb-tls-certs\") pod \"kube-auth-proxy-7c44dbb944-n2jcl\" (UID: \"a5517401-298d-4bc1-8bda-ae8d0ae920eb\") " pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:56.030111 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.030081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:56.192025 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.191930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"
Jul 18 01:52:56.343609 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.343580    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl"]
Jul 18 01:52:56.344393 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:52:56.344368    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5517401_298d_4bc1_8bda_ae8d0ae920eb.slice/crio-de933121012303e8c45669039f046404fe57ae88ab284d1f22cf0ee3f18298ff WatchSource:0}: Error finding container de933121012303e8c45669039f046404fe57ae88ab284d1f22cf0ee3f18298ff: Status 404 returned error can't find the container with id de933121012303e8c45669039f046404fe57ae88ab284d1f22cf0ee3f18298ff
Jul 18 01:52:56.674356 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.674295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:56.886297 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.886258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6" event={"ID":"3328d2b6-eb57-4990-b775-0a22a093e841","Type":"ContainerStarted","Data":"bfff607850fedefbb2ffa3d198b78c8a536a1f0d543d7b3715b465f4ea51024b"}
Jul 18 01:52:56.886502 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.886402    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:52:56.888460 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.888432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl" event={"ID":"a5517401-298d-4bc1-8bda-ae8d0ae920eb","Type":"ContainerStarted","Data":"de933121012303e8c45669039f046404fe57ae88ab284d1f22cf0ee3f18298ff"}
Jul 18 01:52:56.919471 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.919412    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6" podStartSLOduration=1.501018122 podStartE2EDuration="2.91938905s" totalImagesPullingTime="1.418370928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:56.918445033 +0000 UTC m=+284.317844687" watchObservedRunningTime="2026-07-18 01:52:56.91938905 +0000 UTC m=+284.318788710"
Jul 18 01:52:56.933234 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:56.933149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:57.231619 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:57.231540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:57.397220 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:57.397184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:58.550932 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:58.550896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:52:59.904332 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:59.904294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl" event={"ID":"a5517401-298d-4bc1-8bda-ae8d0ae920eb","Type":"ContainerStarted","Data":"f2d6faa226b4d7bc0431eea604b38f21dfe083c8f5911ab4a58d5ed5fec1299d"}
Jul 18 01:52:59.922643 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:52:59.922578    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c44dbb944-n2jcl" podStartSLOduration=2.423587001 podStartE2EDuration="4.922560978s" totalImagesPullingTime="2.498973977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:59.921187407 +0000 UTC m=+287.320587066" watchObservedRunningTime="2026-07-18 01:52:59.922560978 +0000 UTC m=+287.321960637"
Jul 18 01:53:02.807122 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:02.807089    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:02.906912 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:02.906871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:03.825900 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:03.825858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:04.219869 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:04.219786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:04.329089 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:04.329054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:05.434969 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:05.434933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:07.245345 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:07.245300    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:07.896297 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:07.896268    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b6fc5d786-4smw6"
Jul 18 01:53:12.105754 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:12.105721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:12.980130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:12.980102    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 01:53:38.912918 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:38.912876    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:56.163173 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:56.163139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:56.287775 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:56.287740    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:53:56.388696 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:53:56.388668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:26.159297 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:26.159256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:30.371152 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:30.371116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:32.834024 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:32.833990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:32.953024 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:32.952984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:34.195957 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:34.195925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:37.339986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:37.339944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:37.727130 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:37.727041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:38.026018 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:38.025988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:40.769076 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:40.769046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:41.193443 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.193344    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-547c96dc77-cf5j9"]
Jul 18 01:54:41.196841 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.196813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.199225 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.199197    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 18 01:54:41.200053 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.200025    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 18 01:54:41.200167 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.200057    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 18 01:54:41.200307 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.200290    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 01:54:41.200388 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.200313    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 18 01:54:41.200388 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.200315    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qcq5b\""
Jul 18 01:54:41.200388 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.200374    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 18 01:54:41.200531 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.200388    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 01:54:41.204992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.204976    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 18 01:54:41.208059 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.208036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547c96dc77-cf5j9"]
Jul 18 01:54:41.245188 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.245152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:41.305702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.305669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-oauth-config\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.305702 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.305705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-config\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.305941 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.305734    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-oauth-serving-cert\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.305941 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.305817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-serving-cert\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.305941 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.305847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-trusted-ca-bundle\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.305941 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.305865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88dxd\" (UniqueName: \"kubernetes.io/projected/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-kube-api-access-88dxd\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.306105 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.305981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-service-ca\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.347177 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.347149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:41.407040 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-oauth-config\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.407040 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-config\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.407273 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-oauth-serving-cert\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.407273 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-serving-cert\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.407273 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-trusted-ca-bundle\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.407273 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88dxd\" (UniqueName: \"kubernetes.io/projected/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-kube-api-access-88dxd\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.407528 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-service-ca\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.408004 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-oauth-serving-cert\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.408004 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.408001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-service-ca\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.408232 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.407978    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-config\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.408232 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.408179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-trusted-ca-bundle\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.409552 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.409524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-oauth-config\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.409660 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.409642    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-console-serving-cert\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.418274 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.418252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88dxd\" (UniqueName: \"kubernetes.io/projected/8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3-kube-api-access-88dxd\") pod \"console-547c96dc77-cf5j9\" (UID: \"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3\") " pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.507158 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.507124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:41.640948 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:41.640908    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547c96dc77-cf5j9"]
Jul 18 01:54:41.644529 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:54:41.644506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e222d88_1b7a_4bb7_badf_5ac9f92fbdd3.slice/crio-3eb4e1bbbe663392d652e5fd3813c5c73c5ed7e92298761fbd420fe7dddd2ce2 WatchSource:0}: Error finding container 3eb4e1bbbe663392d652e5fd3813c5c73c5ed7e92298761fbd420fe7dddd2ce2: Status 404 returned error can't find the container with id 3eb4e1bbbe663392d652e5fd3813c5c73c5ed7e92298761fbd420fe7dddd2ce2
Jul 18 01:54:42.220212 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:42.220174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:42.320391 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:42.320352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:42.377763 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:42.377725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547c96dc77-cf5j9" event={"ID":"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3","Type":"ContainerStarted","Data":"05dab34dceee3d927d56deaf2b25cb505e98f3a30f1cc5439ef641b3ef1ae316"}
Jul 18 01:54:42.377976 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:42.377816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547c96dc77-cf5j9" event={"ID":"8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3","Type":"ContainerStarted","Data":"3eb4e1bbbe663392d652e5fd3813c5c73c5ed7e92298761fbd420fe7dddd2ce2"}
Jul 18 01:54:42.395743 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:42.395689    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-547c96dc77-cf5j9" podStartSLOduration=1.395668609 podStartE2EDuration="1.395668609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:54:42.394874885 +0000 UTC m=+389.794274567" watchObservedRunningTime="2026-07-18 01:54:42.395668609 +0000 UTC m=+389.795068269"
Jul 18 01:54:46.205210 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:46.205178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:46.297244 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:46.297212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:47.200806 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.200771    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"]
Jul 18 01:54:47.204446 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.204426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.206972 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.206950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 18 01:54:47.207393 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.207241    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 18 01:54:47.207393 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.207346    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 01:54:47.207791 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.207749    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq2tw\""
Jul 18 01:54:47.207949 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.207934    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 01:54:47.226585 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.226550    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"]
Jul 18 01:54:47.240985 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.240909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:47.328079 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.328025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:47.366271 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.366238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/026f5850-4c6f-4789-a8fe-055adbe70b27-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.366478 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.366292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/026f5850-4c6f-4789-a8fe-055adbe70b27-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.366478 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.366444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twhvw\" (UniqueName: \"kubernetes.io/projected/026f5850-4c6f-4789-a8fe-055adbe70b27-kube-api-access-twhvw\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.467419 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.467271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/026f5850-4c6f-4789-a8fe-055adbe70b27-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.467419 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.467376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twhvw\" (UniqueName: \"kubernetes.io/projected/026f5850-4c6f-4789-a8fe-055adbe70b27-kube-api-access-twhvw\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.467419 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.467409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/026f5850-4c6f-4789-a8fe-055adbe70b27-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.468103 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.468082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/026f5850-4c6f-4789-a8fe-055adbe70b27-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.469745 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.469723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/026f5850-4c6f-4789-a8fe-055adbe70b27-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.475755 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.475729    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twhvw\" (UniqueName: \"kubernetes.io/projected/026f5850-4c6f-4789-a8fe-055adbe70b27-kube-api-access-twhvw\") pod \"kuadrant-console-plugin-66b5774985-cv8dh\" (UID: \"026f5850-4c6f-4789-a8fe-055adbe70b27\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.513818 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.513775    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"
Jul 18 01:54:47.659871 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.659835    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh"]
Jul 18 01:54:47.663222 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:54:47.663195    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod026f5850_4c6f_4789_a8fe_055adbe70b27.slice/crio-bda6f2664b17467d8f57a0a3582b872036af31991d9165bde2d730a3d3ff4681 WatchSource:0}: Error finding container bda6f2664b17467d8f57a0a3582b872036af31991d9165bde2d730a3d3ff4681: Status 404 returned error can't find the container with id bda6f2664b17467d8f57a0a3582b872036af31991d9165bde2d730a3d3ff4681
Jul 18 01:54:47.664971 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:47.664946    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:54:48.407285 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:48.407249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh" event={"ID":"026f5850-4c6f-4789-a8fe-055adbe70b27","Type":"ContainerStarted","Data":"bda6f2664b17467d8f57a0a3582b872036af31991d9165bde2d730a3d3ff4681"}
Jul 18 01:54:49.344146 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:49.344100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:49.508360 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:49.508305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:51.507290 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:51.507248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:51.507737 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:51.507434    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:51.513986 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:51.513946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:52.439185 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:52.439154    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-547c96dc77-cf5j9"
Jul 18 01:54:52.603917 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:52.603879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:52.705844 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:52.705767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:52.804178 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:52.804145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:57.792606 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:57.792554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:54:57.895056 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:54:57.895024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:00.273060 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:00.273011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:00.373430 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:00.373390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:03.099628 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:03.099578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:03.200026 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:03.199985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:06.633531 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:06.633485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:06.733752 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:06.733713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:10.539105 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:10.539064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh" event={"ID":"026f5850-4c6f-4789-a8fe-055adbe70b27","Type":"ContainerStarted","Data":"81f07d76e691ca84473dea5c53492d3a3900ee5e2a5a1facd9c0b4009157fd5c"}
Jul 18 01:55:10.556148 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:10.556093    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cv8dh" podStartSLOduration=1.52743586 podStartE2EDuration="23.556077369s" totalImagesPullingTime="22.028641509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:10.555159441 +0000 UTC m=+417.954559100" watchObservedRunningTime="2026-07-18 01:55:10.556077369 +0000 UTC m=+417.955477028"
Jul 18 01:55:15.490429 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:15.490392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:15.586368 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:15.586315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:18.080593 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:18.080555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:18.186105 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:18.186069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:21.350274 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:21.350236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:21.451582 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:21.451542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:24.712452 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:24.712421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:24.814239 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:24.814204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:26.533284 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:26.533253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:26.674544 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:26.674511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:33.343302 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:33.343270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:33.442630 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:33.442595    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:39.314859 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.314772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:39.323019 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.322985    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"]
Jul 18 01:55:39.429452 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.429411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:39.443803 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.443762    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"]
Jul 18 01:55:39.443803 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.443809    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"]
Jul 18 01:55:39.443992 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.443887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:39.446199 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.446176    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 18 01:55:39.533768 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.533716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:39.555055 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.555010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6j77\" (UniqueName: \"kubernetes.io/projected/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-kube-api-access-g6j77\") pod \"limitador-limitador-64c94fd64f-zpm4j\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:39.555238 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.555192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-config-file\") pod \"limitador-limitador-64c94fd64f-zpm4j\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:39.656283 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.656199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-config-file\") pod \"limitador-limitador-64c94fd64f-zpm4j\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:39.656473 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.656282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6j77\" (UniqueName: \"kubernetes.io/projected/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-kube-api-access-g6j77\") pod \"limitador-limitador-64c94fd64f-zpm4j\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:39.656860 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.656841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-config-file\") pod \"limitador-limitador-64c94fd64f-zpm4j\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:39.664731 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.664700    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6j77\" (UniqueName: \"kubernetes.io/projected/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-kube-api-access-g6j77\") pod \"limitador-limitador-64c94fd64f-zpm4j\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:39.755121 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:39.755090    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:40.008017 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:40.007991    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"]
Jul 18 01:55:40.011198 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:55:40.011163    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b5a1ba_8868_497b_b05d_0afe4c566ab9.slice/crio-5148bece656bfd3b66f098a1bccac501e91f15717e266edfe84f7402ce261e2e WatchSource:0}: Error finding container 5148bece656bfd3b66f098a1bccac501e91f15717e266edfe84f7402ce261e2e: Status 404 returned error can't find the container with id 5148bece656bfd3b66f098a1bccac501e91f15717e266edfe84f7402ce261e2e
Jul 18 01:55:40.170542 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:40.170506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:40.230072 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:40.229965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:40.685533 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:40.685487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j" event={"ID":"f5b5a1ba-8868-497b-b05d-0afe4c566ab9","Type":"ContainerStarted","Data":"5148bece656bfd3b66f098a1bccac501e91f15717e266edfe84f7402ce261e2e"}
Jul 18 01:55:42.696944 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:42.696909    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j" event={"ID":"f5b5a1ba-8868-497b-b05d-0afe4c566ab9","Type":"ContainerStarted","Data":"1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5"}
Jul 18 01:55:42.697317 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:42.697061    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:42.719339 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:42.719273    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j" podStartSLOduration=1.126181259 podStartE2EDuration="3.719256481s" totalImagesPullingTime="2.593075222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:42.716462931 +0000 UTC m=+450.115862591" watchObservedRunningTime="2026-07-18 01:55:42.719256481 +0000 UTC m=+450.118656139"
Jul 18 01:55:47.194050 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:47.194016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:53.702564 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:53.702535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:53.939692 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:53.939653    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"]
Jul 18 01:55:53.939883 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:53.939837    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j" podUID="f5b5a1ba-8868-497b-b05d-0afe4c566ab9" containerName="limitador" containerID="cri-o://1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5" gracePeriod=30
Jul 18 01:55:54.492443 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.492416    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:54.593401 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.593356    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6j77\" (UniqueName: \"kubernetes.io/projected/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-kube-api-access-g6j77\") pod \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") "
Jul 18 01:55:54.593608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.593442    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-config-file\") pod \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\" (UID: \"f5b5a1ba-8868-497b-b05d-0afe4c566ab9\") "
Jul 18 01:55:54.593805 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.593781    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-config-file" (OuterVolumeSpecName: "config-file") pod "f5b5a1ba-8868-497b-b05d-0afe4c566ab9" (UID: "f5b5a1ba-8868-497b-b05d-0afe4c566ab9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:55:54.595622 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.595600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-kube-api-access-g6j77" (OuterVolumeSpecName: "kube-api-access-g6j77") pod "f5b5a1ba-8868-497b-b05d-0afe4c566ab9" (UID: "f5b5a1ba-8868-497b-b05d-0afe4c566ab9"). InnerVolumeSpecName "kube-api-access-g6j77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:55:54.694946 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.694910    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-config-file\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:55:54.694946 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.694939    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6j77\" (UniqueName: \"kubernetes.io/projected/f5b5a1ba-8868-497b-b05d-0afe4c566ab9-kube-api-access-g6j77\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 01:55:54.752302 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.752266    2562 generic.go:356] "Generic (PLEG): container finished" podID="f5b5a1ba-8868-497b-b05d-0afe4c566ab9" containerID="1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5" exitCode=0
Jul 18 01:55:54.752715 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.752349    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"
Jul 18 01:55:54.752715 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.752364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j" event={"ID":"f5b5a1ba-8868-497b-b05d-0afe4c566ab9","Type":"ContainerDied","Data":"1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5"}
Jul 18 01:55:54.752715 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.752428    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zpm4j" event={"ID":"f5b5a1ba-8868-497b-b05d-0afe4c566ab9","Type":"ContainerDied","Data":"5148bece656bfd3b66f098a1bccac501e91f15717e266edfe84f7402ce261e2e"}
Jul 18 01:55:54.752715 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.752459    2562 scope.go:117] "RemoveContainer" containerID="1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5"
Jul 18 01:55:54.761063 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.761042    2562 scope.go:117] "RemoveContainer" containerID="1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5"
Jul 18 01:55:54.761309 ip-10-0-137-80 kubenswrapper[2562]: E0718 01:55:54.761291    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5\": container with ID starting with 1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5 not found: ID does not exist" containerID="1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5"
Jul 18 01:55:54.761364 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.761317    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5"} err="failed to get container status \"1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5\": rpc error: code = NotFound desc = could not find container \"1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5\": container with ID starting with 1b253be880fdfc3e648fbb434378d263150ceea248ea83d31b126c2d5925f1e5 not found: ID does not exist"
Jul 18 01:55:54.773989 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.773962    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"]
Jul 18 01:55:54.778141 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:54.778121    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zpm4j"]
Jul 18 01:55:56.531120 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:56.531086    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b5a1ba-8868-497b-b05d-0afe4c566ab9" path="/var/lib/kubelet/pods/f5b5a1ba-8868-497b-b05d-0afe4c566ab9/volumes"
Jul 18 01:55:59.803139 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:59.803102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:55:59.895213 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:55:59.895178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:00.290083 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.290050    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"]
Jul 18 01:56:00.290500 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.290487    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b5a1ba-8868-497b-b05d-0afe4c566ab9" containerName="limitador"
Jul 18 01:56:00.290560 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.290502    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b5a1ba-8868-497b-b05d-0afe4c566ab9" containerName="limitador"
Jul 18 01:56:00.290597 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.290563    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b5a1ba-8868-497b-b05d-0afe4c566ab9" containerName="limitador"
Jul 18 01:56:00.294911 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.294890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.297292 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.297269    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 18 01:56:00.297428 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.297309    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 01:56:00.297428 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.297332    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 18 01:56:00.298042 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.298028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7cgtf\""
Jul 18 01:56:00.301367 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.301346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"]
Jul 18 01:56:00.319509 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.319478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:00.342857 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.342823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9qhs\" (UniqueName: \"kubernetes.io/projected/d3fda4fc-5f05-46de-9e4f-2945418d5a36-kube-api-access-g9qhs\") pod \"postgres-69fb4594cf-94kpn\" (UID: \"d3fda4fc-5f05-46de-9e4f-2945418d5a36\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.343045 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.342864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d3fda4fc-5f05-46de-9e4f-2945418d5a36-data\") pod \"postgres-69fb4594cf-94kpn\" (UID: \"d3fda4fc-5f05-46de-9e4f-2945418d5a36\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.443531 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.443486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9qhs\" (UniqueName: \"kubernetes.io/projected/d3fda4fc-5f05-46de-9e4f-2945418d5a36-kube-api-access-g9qhs\") pod \"postgres-69fb4594cf-94kpn\" (UID: \"d3fda4fc-5f05-46de-9e4f-2945418d5a36\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.443531 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.443533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d3fda4fc-5f05-46de-9e4f-2945418d5a36-data\") pod \"postgres-69fb4594cf-94kpn\" (UID: \"d3fda4fc-5f05-46de-9e4f-2945418d5a36\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.443966 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.443945    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d3fda4fc-5f05-46de-9e4f-2945418d5a36-data\") pod \"postgres-69fb4594cf-94kpn\" (UID: \"d3fda4fc-5f05-46de-9e4f-2945418d5a36\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.456425 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.456390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9qhs\" (UniqueName: \"kubernetes.io/projected/d3fda4fc-5f05-46de-9e4f-2945418d5a36-kube-api-access-g9qhs\") pod \"postgres-69fb4594cf-94kpn\" (UID: \"d3fda4fc-5f05-46de-9e4f-2945418d5a36\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.606267 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.606165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:00.751125 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.751040    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"]
Jul 18 01:56:00.753685 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:56:00.753652    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fda4fc_5f05_46de_9e4f_2945418d5a36.slice/crio-5f1fbcea372cfdae2544865529efe5b68a559e2e9709c41490ba28de983b3858 WatchSource:0}: Error finding container 5f1fbcea372cfdae2544865529efe5b68a559e2e9709c41490ba28de983b3858: Status 404 returned error can't find the container with id 5f1fbcea372cfdae2544865529efe5b68a559e2e9709c41490ba28de983b3858
Jul 18 01:56:00.783973 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:00.783938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn" event={"ID":"d3fda4fc-5f05-46de-9e4f-2945418d5a36","Type":"ContainerStarted","Data":"5f1fbcea372cfdae2544865529efe5b68a559e2e9709c41490ba28de983b3858"}
Jul 18 01:56:05.813217 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:05.813166    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn" event={"ID":"d3fda4fc-5f05-46de-9e4f-2945418d5a36","Type":"ContainerStarted","Data":"1cc6b3ecdc9c77d8e3dc6c9c2eda4b791675b50e176bcd6f136da51f079b435c"}
Jul 18 01:56:05.813773 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:05.813283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:05.832029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:05.831971    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn" podStartSLOduration=1.188080771 podStartE2EDuration="5.831951658s" totalImagesPullingTime="4.643870887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:56:05.829016281 +0000 UTC m=+473.228415940" watchObservedRunningTime="2026-07-18 01:56:05.831951658 +0000 UTC m=+473.231351316"
Jul 18 01:56:11.851798 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:11.851766    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-94kpn"
Jul 18 01:56:12.166412 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.166294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:12.397259 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.397227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:12.899716 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.899682    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5649dd4cbb-h8k4k"]
Jul 18 01:56:12.905917 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.905895    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:12.910887 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.910865    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 01:56:12.911931 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.911908    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bsnwq\""
Jul 18 01:56:12.919162 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.919138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5649dd4cbb-h8k4k"]
Jul 18 01:56:12.969953 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.969917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7414d689-b834-4ab5-a570-793fd237a259-tls-cert\") pod \"authorino-5649dd4cbb-h8k4k\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") " pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:12.970133 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:12.970008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvlsk\" (UniqueName: \"kubernetes.io/projected/7414d689-b834-4ab5-a570-793fd237a259-kube-api-access-bvlsk\") pod \"authorino-5649dd4cbb-h8k4k\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") " pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:13.071580 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.071534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7414d689-b834-4ab5-a570-793fd237a259-tls-cert\") pod \"authorino-5649dd4cbb-h8k4k\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") " pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:13.071782 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.071618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvlsk\" (UniqueName: \"kubernetes.io/projected/7414d689-b834-4ab5-a570-793fd237a259-kube-api-access-bvlsk\") pod \"authorino-5649dd4cbb-h8k4k\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") " pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:13.077042 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.077020    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 01:56:13.084369 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.084314    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7414d689-b834-4ab5-a570-793fd237a259-tls-cert\") pod \"authorino-5649dd4cbb-h8k4k\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") " pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:13.087966 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.087940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvlsk\" (UniqueName: \"kubernetes.io/projected/7414d689-b834-4ab5-a570-793fd237a259-kube-api-access-bvlsk\") pod \"authorino-5649dd4cbb-h8k4k\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") " pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:13.218354 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.218256    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bsnwq\""
Jul 18 01:56:13.226248 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.226218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 01:56:13.364925 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.364894    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5649dd4cbb-h8k4k"]
Jul 18 01:56:13.368517 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:56:13.368484    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7414d689_b834_4ab5_a570_793fd237a259.slice/crio-871d2367226ca68281cf075fe05294159b639d052d2cbbb9327b40e1834dae69 WatchSource:0}: Error finding container 871d2367226ca68281cf075fe05294159b639d052d2cbbb9327b40e1834dae69: Status 404 returned error can't find the container with id 871d2367226ca68281cf075fe05294159b639d052d2cbbb9327b40e1834dae69
Jul 18 01:56:13.859693 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:13.859651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k" event={"ID":"7414d689-b834-4ab5-a570-793fd237a259","Type":"ContainerStarted","Data":"871d2367226ca68281cf075fe05294159b639d052d2cbbb9327b40e1834dae69"}
Jul 18 01:56:16.876803 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:16.876761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k" event={"ID":"7414d689-b834-4ab5-a570-793fd237a259","Type":"ContainerStarted","Data":"f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c"}
Jul 18 01:56:16.892643 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:16.892582    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k" podStartSLOduration=2.107949168 podStartE2EDuration="4.89256427s" totalImagesPullingTime="2.784615102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:56:16.892141615 +0000 UTC m=+484.291541275" watchObservedRunningTime="2026-07-18 01:56:16.89256427 +0000 UTC m=+484.291963966"
Jul 18 01:56:19.226342 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:19.226302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:19.333853 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:19.333819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:21.689041 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:21.689005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:21.794481 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:21.794435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:21.872176 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:21.872146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:25.199652 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:25.199613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:25.303569 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:25.303542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:54.689314 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:54.689277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:54.787539 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:54.787505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:55.216579 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:55.216537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:55.734798 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:55.734766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:55.835714 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:55.835673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:56:55.941029 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:56:55.940948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:05.477341 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:05.477226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:05.542235 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:05.542196    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:07.718222 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:07.718188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:07.817844 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:07.817810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:11.489653 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.489611    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"]
Jul 18 01:57:11.493635 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.493612    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.496045 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.496016    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dghpp\""
Jul 18 01:57:11.496045 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.496042    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 01:57:11.496750 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.496732    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 18 01:57:11.496819 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.496732    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 01:57:11.505007 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.504977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"]
Jul 18 01:57:11.517136 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.517101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r226g\" (UniqueName: \"kubernetes.io/projected/14de4a83-a106-42db-b9fe-50285998f3cf-kube-api-access-r226g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.517136 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.517144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.517380 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.517170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14de4a83-a106-42db-b9fe-50285998f3cf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.517380 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.517253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.517380 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.517279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.517380 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.517297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.520667 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.520631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:11.617916 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.617880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r226g\" (UniqueName: \"kubernetes.io/projected/14de4a83-a106-42db-b9fe-50285998f3cf-kube-api-access-r226g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618125 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.617930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618125 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.617965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14de4a83-a106-42db-b9fe-50285998f3cf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618125 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.618048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618125 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.618080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618125 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.618107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618508 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.618485    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618569 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.618509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.618608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.618573    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.620428 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.620406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14de4a83-a106-42db-b9fe-50285998f3cf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.620799 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.620778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14de4a83-a106-42db-b9fe-50285998f3cf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.627014 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.626987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r226g\" (UniqueName: \"kubernetes.io/projected/14de4a83-a106-42db-b9fe-50285998f3cf-kube-api-access-r226g\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c\" (UID: \"14de4a83-a106-42db-b9fe-50285998f3cf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.806099 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.806052    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:11.976123 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:11.976026    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"]
Jul 18 01:57:11.981453 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:57:11.981420    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14de4a83_a106_42db_b9fe_50285998f3cf.slice/crio-271e2ebc3c9061653ce3f969942d81e0c0cdbd029544ae8e331b63b263328256 WatchSource:0}: Error finding container 271e2ebc3c9061653ce3f969942d81e0c0cdbd029544ae8e331b63b263328256: Status 404 returned error can't find the container with id 271e2ebc3c9061653ce3f969942d81e0c0cdbd029544ae8e331b63b263328256
Jul 18 01:57:12.138290 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:12.138207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c" event={"ID":"14de4a83-a106-42db-b9fe-50285998f3cf","Type":"ContainerStarted","Data":"271e2ebc3c9061653ce3f969942d81e0c0cdbd029544ae8e331b63b263328256"}
Jul 18 01:57:13.146111 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:13.146039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c" event={"ID":"14de4a83-a106-42db-b9fe-50285998f3cf","Type":"ContainerStarted","Data":"185a012f2ca4453daacf5bc5cb38f8946f23c5adb713a739b31e3ea9ad134c19"}
Jul 18 01:57:13.164822 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:13.164763    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c" podStartSLOduration=1.098799926 podStartE2EDuration="2.164743162s" totalImagesPullingTime="1.065943236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:57:13.163743937 +0000 UTC m=+540.563143594" watchObservedRunningTime="2026-07-18 01:57:13.164743162 +0000 UTC m=+540.564142822"
Jul 18 01:57:14.693607 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:14.693575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:21.807143 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:21.807095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:21.807642 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:21.807179    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:21.819656 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:21.819632    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:22.201385 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:22.201286    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c"
Jul 18 01:57:37.428504 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.428470    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"]
Jul 18 01:57:37.431773 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.431754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.434257 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.434232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 18 01:57:37.449054 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.449024    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"]
Jul 18 01:57:37.511134 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.511096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:37.561492 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.561456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5b89a1-b810-42dd-9be5-d67541963cfb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.561660 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.561511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bswk8\" (UniqueName: \"kubernetes.io/projected/9e5b89a1-b810-42dd-9be5-d67541963cfb-kube-api-access-bswk8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.561660 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.561540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.561660 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.561619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.561660 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.561642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.561660 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.561661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.662724 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.662686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.662724 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.662723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.662936 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.662779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5b89a1-b810-42dd-9be5-d67541963cfb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.662936 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.662813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bswk8\" (UniqueName: \"kubernetes.io/projected/9e5b89a1-b810-42dd-9be5-d67541963cfb-kube-api-access-bswk8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.662936 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.662833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.662936 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.662907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.663244 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.663205    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.663244 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.663238    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.663473 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.663276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.664979 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.664950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e5b89a1-b810-42dd-9be5-d67541963cfb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.665240 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.665219    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5b89a1-b810-42dd-9be5-d67541963cfb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.671121 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.671101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bswk8\" (UniqueName: \"kubernetes.io/projected/9e5b89a1-b810-42dd-9be5-d67541963cfb-kube-api-access-bswk8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2cgv2\" (UID: \"9e5b89a1-b810-42dd-9be5-d67541963cfb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.742278 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.742179    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:37.881855 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:37.881818    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"]
Jul 18 01:57:37.883597 ip-10-0-137-80 kubenswrapper[2562]: W0718 01:57:37.883568    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5b89a1_b810_42dd_9be5_d67541963cfb.slice/crio-a41ae57c1295e0c67ef285fa6970361d8d12320b83511f26f4207a29dcae3081 WatchSource:0}: Error finding container a41ae57c1295e0c67ef285fa6970361d8d12320b83511f26f4207a29dcae3081: Status 404 returned error can't find the container with id a41ae57c1295e0c67ef285fa6970361d8d12320b83511f26f4207a29dcae3081
Jul 18 01:57:38.267824 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:38.267790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2" event={"ID":"9e5b89a1-b810-42dd-9be5-d67541963cfb","Type":"ContainerStarted","Data":"314275ca197273bd695f2dc5d9d97611302336cd716772378eed18967feef556"}
Jul 18 01:57:38.268001 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:38.267845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2" event={"ID":"9e5b89a1-b810-42dd-9be5-d67541963cfb","Type":"ContainerStarted","Data":"a41ae57c1295e0c67ef285fa6970361d8d12320b83511f26f4207a29dcae3081"}
Jul 18 01:57:38.285237 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:38.285184    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2" podStartSLOduration=1.126782234 podStartE2EDuration="1.28516569s" totalImagesPullingTime="158.383456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:57:38.283707869 +0000 UTC m=+565.683107528" watchObservedRunningTime="2026-07-18 01:57:38.28516569 +0000 UTC m=+565.684565348"
Jul 18 01:57:40.454427 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:40.454381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:40.554798 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:40.554751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:43.512608 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:43.512550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:47.743246 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:47.743199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:47.743763 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:47.743357    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:47.755912 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:47.755880    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:48.325907 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:48.325876    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2cgv2"
Jul 18 01:57:54.530107 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:54.530056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:57.018293 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:57.018223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:57:57.119811 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:57:57.119762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:58:01.407448 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:58:01.407411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 01:58:35.607554 ip-10-0-137-80 kubenswrapper[2562]: I0718 01:58:35.607469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:00:11.896610 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:11.896524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:00:12.066601 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.066561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:00:12.637640 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.637594    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5649dd4cbb-h8k4k"]
Jul 18 02:00:12.637852 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.637769    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k" podUID="7414d689-b834-4ab5-a570-793fd237a259" containerName="authorino" containerID="cri-o://f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c" gracePeriod=30
Jul 18 02:00:12.883020 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.882991    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 02:00:12.947697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.947611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvlsk\" (UniqueName: \"kubernetes.io/projected/7414d689-b834-4ab5-a570-793fd237a259-kube-api-access-bvlsk\") pod \"7414d689-b834-4ab5-a570-793fd237a259\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") "
Jul 18 02:00:12.947697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.947679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7414d689-b834-4ab5-a570-793fd237a259-tls-cert\") pod \"7414d689-b834-4ab5-a570-793fd237a259\" (UID: \"7414d689-b834-4ab5-a570-793fd237a259\") "
Jul 18 02:00:12.949895 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.949864    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7414d689-b834-4ab5-a570-793fd237a259-kube-api-access-bvlsk" (OuterVolumeSpecName: "kube-api-access-bvlsk") pod "7414d689-b834-4ab5-a570-793fd237a259" (UID: "7414d689-b834-4ab5-a570-793fd237a259"). InnerVolumeSpecName "kube-api-access-bvlsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:00:12.958425 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:12.958394    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7414d689-b834-4ab5-a570-793fd237a259-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7414d689-b834-4ab5-a570-793fd237a259" (UID: "7414d689-b834-4ab5-a570-793fd237a259"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:00:13.014100 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.014051    2562 generic.go:356] "Generic (PLEG): container finished" podID="7414d689-b834-4ab5-a570-793fd237a259" containerID="f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c" exitCode=0
Jul 18 02:00:13.014100 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.014090    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k"
Jul 18 02:00:13.014317 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.014113    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k" event={"ID":"7414d689-b834-4ab5-a570-793fd237a259","Type":"ContainerDied","Data":"f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c"}
Jul 18 02:00:13.014317 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.014149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649dd4cbb-h8k4k" event={"ID":"7414d689-b834-4ab5-a570-793fd237a259","Type":"ContainerDied","Data":"871d2367226ca68281cf075fe05294159b639d052d2cbbb9327b40e1834dae69"}
Jul 18 02:00:13.014317 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.014167    2562 scope.go:117] "RemoveContainer" containerID="f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c"
Jul 18 02:00:13.022430 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.022400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:00:13.023083 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.023067    2562 scope.go:117] "RemoveContainer" containerID="f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c"
Jul 18 02:00:13.023379 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:00:13.023360    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c\": container with ID starting with f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c not found: ID does not exist" containerID="f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c"
Jul 18 02:00:13.023437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.023389    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c"} err="failed to get container status \"f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c\": rpc error: code = NotFound desc = could not find container \"f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c\": container with ID starting with f1026c926a7d2b785bfb56e118c57630f456daa65429a2fb485e9866c0f9fe1c not found: ID does not exist"
Jul 18 02:00:13.034411 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.034383    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5649dd4cbb-h8k4k"]
Jul 18 02:00:13.041258 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.041237    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5649dd4cbb-h8k4k"]
Jul 18 02:00:13.049248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.049227    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvlsk\" (UniqueName: \"kubernetes.io/projected/7414d689-b834-4ab5-a570-793fd237a259-kube-api-access-bvlsk\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:00:13.049311 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.049253    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7414d689-b834-4ab5-a570-793fd237a259-tls-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:00:13.122928 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:13.122898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:00:14.531617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:00:14.531580    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7414d689-b834-4ab5-a570-793fd237a259" path="/var/lib/kubelet/pods/7414d689-b834-4ab5-a570-793fd237a259/volumes"
Jul 18 02:01:08.281710 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:01:08.281668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:01:18.686058 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:01:18.686020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:01:18.741245 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:01:18.741205    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:01:36.013947 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:01:36.013860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:02:16.681035 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:02:16.680999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:02:17.909822 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:02:17.909783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:00.554163 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:00.554127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:00.653723 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:00.653686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:00.916190 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:00.916090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:06.602603 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:06.602528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:06.704980 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:06.704937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:06.802650 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:06.802613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:06.945785 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:06.945697    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:12.696782 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:12.696752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:03:12.797462 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:03:12.797424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:06:36.776250 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:06:36.776215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:06:38.281120 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:06:38.281082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:07:22.948840 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:07:22.948804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:07:33.703451 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:07:33.703407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:10:18.097631 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:10:18.097595    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:10:18.187157 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:10:18.187122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:08.491608 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:08.491493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:17.833403 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:17.833368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:18.081389 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:18.081357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:26.080761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:26.080717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:31.301836 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:31.301804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:34.258333 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:34.258291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:34.356099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:34.356059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:34.729314 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:34.729217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:40.501055 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:40.501005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:40.602652 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:40.602616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:40.728400 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:40.728362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:41.037825 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:41.037790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:41.664436 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:41.664396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:43.414679 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.414646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:43.498423 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.498389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:43.500765 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.500738    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"]
Jul 18 02:14:43.501346 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.501311    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7414d689-b834-4ab5-a570-793fd237a259" containerName="authorino"
Jul 18 02:14:43.501392 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.501350    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7414d689-b834-4ab5-a570-793fd237a259" containerName="authorino"
Jul 18 02:14:43.501510 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.501498    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7414d689-b834-4ab5-a570-793fd237a259" containerName="authorino"
Jul 18 02:14:43.504724 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.504705    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.506663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.506638    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a4dbbda0-serving-cert\""
Jul 18 02:14:43.506794 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.506754    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sfxcd\""
Jul 18 02:14:43.513599 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.512896    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"]
Jul 18 02:14:43.567020 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.566981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:43.677246 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.677151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-openshift-service-ca\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.677246 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.677200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7427\" (UniqueName: \"kubernetes.io/projected/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-kube-api-access-f7427\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.677510 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.677250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-maas-api-tls\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.761952 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.761917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:43.778074 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.778037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-openshift-service-ca\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.778221 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.778088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7427\" (UniqueName: \"kubernetes.io/projected/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-kube-api-access-f7427\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.778221 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.778123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-maas-api-tls\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.778766 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.778743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-openshift-service-ca\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.780670 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.780651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-maas-api-tls\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.786179 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.786155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7427\" (UniqueName: \"kubernetes.io/projected/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-kube-api-access-f7427\") pod \"maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.818072 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.818025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:43.954064 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.954023    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"]
Jul 18 02:14:43.956501 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:14:43.956471    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8faf123_dbbe_4a79_9dd1_81e19e07dc90.slice/crio-d8d876c9e6478c80849dc52451f1d316236b3f7f8a435ddee76a774f19f5eaac WatchSource:0}: Error finding container d8d876c9e6478c80849dc52451f1d316236b3f7f8a435ddee76a774f19f5eaac: Status 404 returned error can't find the container with id d8d876c9e6478c80849dc52451f1d316236b3f7f8a435ddee76a774f19f5eaac
Jul 18 02:14:43.957914 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:43.957897    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:14:44.095501 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:44.095453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:44.174300 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:44.174259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6" event={"ID":"d8faf123-dbbe-4a79-9dd1-81e19e07dc90","Type":"ContainerStarted","Data":"d8d876c9e6478c80849dc52451f1d316236b3f7f8a435ddee76a774f19f5eaac"}
Jul 18 02:14:44.197103 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:44.197063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:14:47.190609 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:47.190569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6" event={"ID":"d8faf123-dbbe-4a79-9dd1-81e19e07dc90","Type":"ContainerStarted","Data":"eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8"}
Jul 18 02:14:47.191022 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:47.190668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:14:47.207829 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:47.207774    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6" podStartSLOduration=2.021553852 podStartE2EDuration="4.207756094s" totalImagesPullingTime="2.186202242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:14:47.205771713 +0000 UTC m=+1594.605171378" watchObservedRunningTime="2026-07-18 02:14:47.207756094 +0000 UTC m=+1594.607155753"
Jul 18 02:14:53.202612 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:14:53.202579    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:15:00.142109 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.142068    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz"]
Jul 18 02:15:00.146465 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.146444    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"]
Jul 18 02:15:00.146583 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.146563    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz"
Jul 18 02:15:00.149786 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.149763    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:15:00.150476 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.150456    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"
Jul 18 02:15:00.154566 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.154540    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz"]
Jul 18 02:15:00.157251 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.157051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"]
Jul 18 02:15:00.162037 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.162013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz"
Jul 18 02:15:00.168312 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.168288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"
Jul 18 02:15:00.307360 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.307289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz"]
Jul 18 02:15:00.311796 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:15:00.311768    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c52df2_8606_4912_b65f_1db167d4e951.slice/crio-5eddab75533a2132757bb9d6076b587a7213251c90e107f7c3d810b8ceb222f0 WatchSource:0}: Error finding container 5eddab75533a2132757bb9d6076b587a7213251c90e107f7c3d810b8ceb222f0: Status 404 returned error can't find the container with id 5eddab75533a2132757bb9d6076b587a7213251c90e107f7c3d810b8ceb222f0
Jul 18 02:15:00.329099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:00.328966    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"]
Jul 18 02:15:00.331410 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:15:00.331380    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930247c9_93fc_4d73_93b9_cf18a907fd28.slice/crio-f8d653406bbc2137c4a327100bb0a7057baebfa2f7cee612137a7958891e260f WatchSource:0}: Error finding container f8d653406bbc2137c4a327100bb0a7057baebfa2f7cee612137a7958891e260f: Status 404 returned error can't find the container with id f8d653406bbc2137c4a327100bb0a7057baebfa2f7cee612137a7958891e260f
Jul 18 02:15:01.260843 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:01.260803    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts" event={"ID":"930247c9-93fc-4d73-93b9-cf18a907fd28","Type":"ContainerStarted","Data":"f8d653406bbc2137c4a327100bb0a7057baebfa2f7cee612137a7958891e260f"}
Jul 18 02:15:01.262303 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:01.262273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz" event={"ID":"12c52df2-8606-4912-b65f-1db167d4e951","Type":"ContainerStarted","Data":"5eddab75533a2132757bb9d6076b587a7213251c90e107f7c3d810b8ceb222f0"}
Jul 18 02:15:03.274684 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:03.274650    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts" event={"ID":"930247c9-93fc-4d73-93b9-cf18a907fd28","Type":"ContainerStarted","Data":"41969c82ccd68825e05f297e11ea92266925e5a322264658ffc54087f4771905"}
Jul 18 02:15:03.288609 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:03.288553    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts" podStartSLOduration=1.098494181 podStartE2EDuration="3.288536962s" totalImagesPullingTime="2.190042781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:15:03.287695106 +0000 UTC m=+1610.687094762" watchObservedRunningTime="2026-07-18 02:15:03.288536962 +0000 UTC m=+1610.687936620"
Jul 18 02:15:04.281251 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:04.281209    2562 generic.go:356] "Generic (PLEG): container finished" podID="930247c9-93fc-4d73-93b9-cf18a907fd28" containerID="41969c82ccd68825e05f297e11ea92266925e5a322264658ffc54087f4771905" exitCode=0
Jul 18 02:15:04.281694 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:04.281258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts" event={"ID":"930247c9-93fc-4d73-93b9-cf18a907fd28","Type":"ContainerDied","Data":"41969c82ccd68825e05f297e11ea92266925e5a322264658ffc54087f4771905"}
Jul 18 02:15:05.425241 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:05.425211    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"
Jul 18 02:15:06.292526 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:06.292497    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"
Jul 18 02:15:06.292710 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:06.292532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts" event={"ID":"930247c9-93fc-4d73-93b9-cf18a907fd28","Type":"ContainerDied","Data":"f8d653406bbc2137c4a327100bb0a7057baebfa2f7cee612137a7958891e260f"}
Jul 18 02:15:06.292710 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:06.292576    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8d653406bbc2137c4a327100bb0a7057baebfa2f7cee612137a7958891e260f"
Jul 18 02:15:09.062711 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.062671    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"]
Jul 18 02:15:09.063103 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.063092    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="930247c9-93fc-4d73-93b9-cf18a907fd28" containerName="cleanup"
Jul 18 02:15:09.063148 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.063104    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="930247c9-93fc-4d73-93b9-cf18a907fd28" containerName="cleanup"
Jul 18 02:15:09.063184 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.063157    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="930247c9-93fc-4d73-93b9-cf18a907fd28" containerName="cleanup"
Jul 18 02:15:09.066559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.066540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"
Jul 18 02:15:09.075413 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.075382    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"]
Jul 18 02:15:09.124101 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.124044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2a0758-d715-4e3c-9966-cd872e1ec801-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q\" (UID: \"9c2a0758-d715-4e3c-9966-cd872e1ec801\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"
Jul 18 02:15:09.225406 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.225369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2a0758-d715-4e3c-9966-cd872e1ec801-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q\" (UID: \"9c2a0758-d715-4e3c-9966-cd872e1ec801\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"
Jul 18 02:15:09.226052 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.226024    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2a0758-d715-4e3c-9966-cd872e1ec801-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q\" (UID: \"9c2a0758-d715-4e3c-9966-cd872e1ec801\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"
Jul 18 02:15:09.379262 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.379170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"
Jul 18 02:15:09.526623 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:09.526554    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"]
Jul 18 02:15:09.529122 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:15:09.529089    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2a0758_d715_4e3c_9966_cd872e1ec801.slice/crio-b97b74f1d47c5c7037704ba5cb821dad7291637c5aa8ae930d1c4631cdb2345c WatchSource:0}: Error finding container b97b74f1d47c5c7037704ba5cb821dad7291637c5aa8ae930d1c4631cdb2345c: Status 404 returned error can't find the container with id b97b74f1d47c5c7037704ba5cb821dad7291637c5aa8ae930d1c4631cdb2345c
Jul 18 02:15:10.314043 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:10.314002    2562 generic.go:356] "Generic (PLEG): container finished" podID="9c2a0758-d715-4e3c-9966-cd872e1ec801" containerID="c63ea4c0a0451132cf6b083db89aaa01e1ebd5f17456b77b5caef1678a7f750f" exitCode=0
Jul 18 02:15:10.314472 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:10.314093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q" event={"ID":"9c2a0758-d715-4e3c-9966-cd872e1ec801","Type":"ContainerDied","Data":"c63ea4c0a0451132cf6b083db89aaa01e1ebd5f17456b77b5caef1678a7f750f"}
Jul 18 02:15:10.314472 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:10.314144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q" event={"ID":"9c2a0758-d715-4e3c-9966-cd872e1ec801","Type":"ContainerStarted","Data":"b97b74f1d47c5c7037704ba5cb821dad7291637c5aa8ae930d1c4631cdb2345c"}
Jul 18 02:15:11.452059 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:11.452034    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"
Jul 18 02:15:11.545890 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:11.545845    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2a0758-d715-4e3c-9966-cd872e1ec801-maas-api-service-ca\") pod \"9c2a0758-d715-4e3c-9966-cd872e1ec801\" (UID: \"9c2a0758-d715-4e3c-9966-cd872e1ec801\") "
Jul 18 02:15:11.546237 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:11.546212    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c2a0758-d715-4e3c-9966-cd872e1ec801-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c2a0758-d715-4e3c-9966-cd872e1ec801" (UID: "9c2a0758-d715-4e3c-9966-cd872e1ec801"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:15:11.647269 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:11.647162    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c2a0758-d715-4e3c-9966-cd872e1ec801-maas-api-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:15:12.325472 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:12.325386    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"
Jul 18 02:15:12.325617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:12.325388    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q" event={"ID":"9c2a0758-d715-4e3c-9966-cd872e1ec801","Type":"ContainerDied","Data":"b97b74f1d47c5c7037704ba5cb821dad7291637c5aa8ae930d1c4631cdb2345c"}
Jul 18 02:15:12.325617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:12.325508    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b97b74f1d47c5c7037704ba5cb821dad7291637c5aa8ae930d1c4631cdb2345c"
Jul 18 02:15:13.331862 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:13.331824    2562 generic.go:356] "Generic (PLEG): container finished" podID="12c52df2-8606-4912-b65f-1db167d4e951" containerID="8f37934b0fa86f5c46b89452aed4d4aba3e6de58795a8e8e67523234fdf8a0c0" exitCode=0
Jul 18 02:15:13.332275 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:13.331913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz" event={"ID":"12c52df2-8606-4912-b65f-1db167d4e951","Type":"ContainerDied","Data":"8f37934b0fa86f5c46b89452aed4d4aba3e6de58795a8e8e67523234fdf8a0c0"}
Jul 18 02:15:14.474651 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:14.474616    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz"
Jul 18 02:15:15.342611 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:15.342571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz" event={"ID":"12c52df2-8606-4912-b65f-1db167d4e951","Type":"ContainerDied","Data":"5eddab75533a2132757bb9d6076b587a7213251c90e107f7c3d810b8ceb222f0"}
Jul 18 02:15:15.342611 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:15.342603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-pgctz"
Jul 18 02:15:15.342834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:15.342633    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5eddab75533a2132757bb9d6076b587a7213251c90e107f7c3d810b8ceb222f0"
Jul 18 02:15:19.447714 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.447679    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"]
Jul 18 02:15:19.448158 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.447887    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6" podUID="d8faf123-dbbe-4a79-9dd1-81e19e07dc90" containerName="maas-api" containerID="cri-o://eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8" gracePeriod=30
Jul 18 02:15:19.481681 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.480363    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"]
Jul 18 02:15:19.488305 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.488269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:19.489048 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.489020    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-a4dbbda0-29739015-hwrts"]
Jul 18 02:15:19.698709 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.698649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:15:19.828586 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.828542    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-maas-api-tls\") pod \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") "
Jul 18 02:15:19.828770 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.828608    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7427\" (UniqueName: \"kubernetes.io/projected/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-kube-api-access-f7427\") pod \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") "
Jul 18 02:15:19.828770 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.828674    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-openshift-service-ca\") pod \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\" (UID: \"d8faf123-dbbe-4a79-9dd1-81e19e07dc90\") "
Jul 18 02:15:19.829066 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.829033    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d8faf123-dbbe-4a79-9dd1-81e19e07dc90" (UID: "d8faf123-dbbe-4a79-9dd1-81e19e07dc90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:15:19.830874 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.830851    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d8faf123-dbbe-4a79-9dd1-81e19e07dc90" (UID: "d8faf123-dbbe-4a79-9dd1-81e19e07dc90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:15:19.830972 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.830901    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-kube-api-access-f7427" (OuterVolumeSpecName: "kube-api-access-f7427") pod "d8faf123-dbbe-4a79-9dd1-81e19e07dc90" (UID: "d8faf123-dbbe-4a79-9dd1-81e19e07dc90"). InnerVolumeSpecName "kube-api-access-f7427". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:15:19.929687 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.929641    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-maas-api-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:15:19.929687 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.929677    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7427\" (UniqueName: \"kubernetes.io/projected/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-kube-api-access-f7427\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:15:19.929687 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:19.929687    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8faf123-dbbe-4a79-9dd1-81e19e07dc90-openshift-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:15:20.369902 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.369865    2562 generic.go:356] "Generic (PLEG): container finished" podID="d8faf123-dbbe-4a79-9dd1-81e19e07dc90" containerID="eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8" exitCode=0
Jul 18 02:15:20.370086 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.369920    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"
Jul 18 02:15:20.370086 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.369952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6" event={"ID":"d8faf123-dbbe-4a79-9dd1-81e19e07dc90","Type":"ContainerDied","Data":"eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8"}
Jul 18 02:15:20.370086 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.370019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6" event={"ID":"d8faf123-dbbe-4a79-9dd1-81e19e07dc90","Type":"ContainerDied","Data":"d8d876c9e6478c80849dc52451f1d316236b3f7f8a435ddee76a774f19f5eaac"}
Jul 18 02:15:20.370086 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.370044    2562 scope.go:117] "RemoveContainer" containerID="eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8"
Jul 18 02:15:20.379641 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.379623    2562 scope.go:117] "RemoveContainer" containerID="eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8"
Jul 18 02:15:20.379946 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:15:20.379922    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8\": container with ID starting with eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8 not found: ID does not exist" containerID="eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8"
Jul 18 02:15:20.379999 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.379956    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8"} err="failed to get container status \"eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8\": rpc error: code = NotFound desc = could not find container \"eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8\": container with ID starting with eeee4eaf6fa2f3b394013b22a8e88527c5d43d4d50f43616bef989f9c64411f8 not found: ID does not exist"
Jul 18 02:15:20.391299 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.391274    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"]
Jul 18 02:15:20.394283 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.394258    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4dbbda0-768f7f445c-cklx6"]
Jul 18 02:15:20.531648 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.531612    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="930247c9-93fc-4d73-93b9-cf18a907fd28" path="/var/lib/kubelet/pods/930247c9-93fc-4d73-93b9-cf18a907fd28/volumes"
Jul 18 02:15:20.532043 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:20.532028    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8faf123-dbbe-4a79-9dd1-81e19e07dc90" path="/var/lib/kubelet/pods/d8faf123-dbbe-4a79-9dd1-81e19e07dc90/volumes"
Jul 18 02:15:24.130533 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.130493    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"]
Jul 18 02:15:24.130915 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.130547    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:24.133363 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.133333    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a4dbbda0-qm57q"]
Jul 18 02:15:24.294559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.294516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:24.532158 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.532126    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2a0758-d715-4e3c-9966-cd872e1ec801" path="/var/lib/kubelet/pods/9c2a0758-d715-4e3c-9966-cd872e1ec801/volumes"
Jul 18 02:15:24.538136 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.538102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:24.832401 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.832283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:24.992798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:24.992752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:25.087158 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.087069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:25.340537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.340453    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"]
Jul 18 02:15:25.340963 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.340905    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2a0758-d715-4e3c-9966-cd872e1ec801" containerName="revoke-keys"
Jul 18 02:15:25.340963 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.340918    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2a0758-d715-4e3c-9966-cd872e1ec801" containerName="revoke-keys"
Jul 18 02:15:25.340963 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.340940    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8faf123-dbbe-4a79-9dd1-81e19e07dc90" containerName="maas-api"
Jul 18 02:15:25.340963 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.340946    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8faf123-dbbe-4a79-9dd1-81e19e07dc90" containerName="maas-api"
Jul 18 02:15:25.340963 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.340953    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c52df2-8606-4912-b65f-1db167d4e951" containerName="cleanup"
Jul 18 02:15:25.340963 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.340963    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c52df2-8606-4912-b65f-1db167d4e951" containerName="cleanup"
Jul 18 02:15:25.341159 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.341021    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c52df2-8606-4912-b65f-1db167d4e951" containerName="cleanup"
Jul 18 02:15:25.341159 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.341030    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8faf123-dbbe-4a79-9dd1-81e19e07dc90" containerName="maas-api"
Jul 18 02:15:25.341159 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.341036    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2a0758-d715-4e3c-9966-cd872e1ec801" containerName="revoke-keys"
Jul 18 02:15:25.349194 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.349170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.353248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.353226    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 02:15:25.353423 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.353317    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d45c47d8-gw-openshift-default-dockercfg-8f66z\""
Jul 18 02:15:25.359217 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.359192    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"]
Jul 18 02:15:25.381205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.381170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:25.481805 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.481762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-certs\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.481805 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.481804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-istio-token\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.482050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.481828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-envoy\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.482050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.481920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-data\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.482050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.481961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-credential-socket\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.482050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.481980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-socket\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.482050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.482000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d67116-4c12-498c-afe4-52ac8a801924-istio-podinfo\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.482050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.482021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d67116-4c12-498c-afe4-52ac8a801924-istiod-ca-cert\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.482254 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.482063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bc5\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-kube-api-access-n8bc5\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-credential-socket\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-socket\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d67116-4c12-498c-afe4-52ac8a801924-istio-podinfo\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d67116-4c12-498c-afe4-52ac8a801924-istiod-ca-cert\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bc5\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-kube-api-access-n8bc5\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-certs\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-istio-token\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-envoy\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.582910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.582897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-data\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.583271 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.583098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-credential-socket\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.583271 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.583116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-certs\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.583426 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.583304    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-data\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.583426 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.583386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-socket\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.583565 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.583545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d67116-4c12-498c-afe4-52ac8a801924-istiod-ca-cert\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.585133 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.585101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-envoy\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.585243 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.585172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d67116-4c12-498c-afe4-52ac8a801924-istio-podinfo\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.591434 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.591376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-istio-token\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.592159 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.592143    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bc5\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-kube-api-access-n8bc5\") pod \"e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") " pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.661075 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.661032    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:25.682207 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.682172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:25.805779 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:25.805749    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"]
Jul 18 02:15:25.808662 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:15:25.808634    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d67116_4c12_498c_afe4_52ac8a801924.slice/crio-3d1346fa606fbbc496ab8a32c04b38093481163a291cfe293c3145d9c43e865f WatchSource:0}: Error finding container 3d1346fa606fbbc496ab8a32c04b38093481163a291cfe293c3145d9c43e865f: Status 404 returned error can't find the container with id 3d1346fa606fbbc496ab8a32c04b38093481163a291cfe293c3145d9c43e865f
Jul 18 02:15:26.403155 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:26.403122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" event={"ID":"20d67116-4c12-498c-afe4-52ac8a801924","Type":"ContainerStarted","Data":"3d1346fa606fbbc496ab8a32c04b38093481163a291cfe293c3145d9c43e865f"}
Jul 18 02:15:28.477195 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:28.477157    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:15:28.477514 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:28.477230    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:15:28.477514 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:28.477259    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:15:29.428216 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:29.428178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" event={"ID":"20d67116-4c12-498c-afe4-52ac8a801924","Type":"ContainerStarted","Data":"f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359"}
Jul 18 02:15:29.447438 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:29.447382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" podStartSLOduration=1.7812697229999999 podStartE2EDuration="4.447363311s" totalImagesPullingTime="2.666093588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:15:29.445941303 +0000 UTC m=+1636.845340992" watchObservedRunningTime="2026-07-18 02:15:29.447363311 +0000 UTC m=+1636.846762970"
Jul 18 02:15:29.661538 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:29.661495    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:29.667467 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:29.667437    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:30.433713 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:30.433679    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:30.434850 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:30.434829    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:30.912227 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:30.912180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:31.116182 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:31.116144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:31.280834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:31.280800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:31.539934 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:31.539842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:31.643421 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:31.643391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:42.493047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:42.492949    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d67116-4c12-498c-afe4-52ac8a801924" containerID="f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359" exitCode=0
Jul 18 02:15:42.493047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:42.493025    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" event={"ID":"20d67116-4c12-498c-afe4-52ac8a801924","Type":"ContainerDied","Data":"f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359"}
Jul 18 02:15:42.493497 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:42.493461    2562 scope.go:117] "RemoveContainer" containerID="f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359"
Jul 18 02:15:42.495422 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:42.495393    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:15:42.495525 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:42.495463    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:15:42.495525 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:42.495497    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:15:43.500107 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:43.500071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" event={"ID":"20d67116-4c12-498c-afe4-52ac8a801924","Type":"ContainerStarted","Data":"4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91"}
Jul 18 02:15:43.662130 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:43.662093    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:43.663277 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:43.663255    2562 patch_prober.go:28] interesting pod/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 18 02:15:43.663353 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:43.663306    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 18 02:15:44.661747 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:44.661710    2562 patch_prober.go:28] interesting pod/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 18 02:15:44.662132 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:44.661778    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 18 02:15:45.433600 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:45.433553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:45.662151 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:45.662114    2562 patch_prober.go:28] interesting pod/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 18 02:15:45.662553 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:45.662168    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 18 02:15:46.661801 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:46.661764    2562 patch_prober.go:28] interesting pod/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 18 02:15:46.661988 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:46.661822    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 18 02:15:47.661780 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:47.661737    2562 patch_prober.go:28] interesting pod/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 18 02:15:47.662194 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:47.661813    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 18 02:15:48.666317 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:48.666282    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:48.667510 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:48.667488    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:15:55.067742 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:55.067704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:15:55.927714 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:55.927672    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"]
Jul 18 02:15:55.930494 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:55.930467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"
Jul 18 02:15:55.932557 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:55.932536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:15:55.939278 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:55.939238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"]
Jul 18 02:15:56.082262 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:56.082219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/082e6715-a4c1-41a9-817a-49cb7e98e291-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx\" (UID: \"082e6715-a4c1-41a9-817a-49cb7e98e291\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"
Jul 18 02:15:56.183224 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:56.183129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/082e6715-a4c1-41a9-817a-49cb7e98e291-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx\" (UID: \"082e6715-a4c1-41a9-817a-49cb7e98e291\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"
Jul 18 02:15:56.183827 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:56.183805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/082e6715-a4c1-41a9-817a-49cb7e98e291-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx\" (UID: \"082e6715-a4c1-41a9-817a-49cb7e98e291\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"
Jul 18 02:15:56.242141 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:56.242105    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"
Jul 18 02:15:56.399067 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:56.399035    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"]
Jul 18 02:15:56.406388 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:15:56.406354    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082e6715_a4c1_41a9_817a_49cb7e98e291.slice/crio-ef0d70c1b5c7ca66887f014330c6621cb6fb6edbf66ee25afb8e9abfa4b4249b WatchSource:0}: Error finding container ef0d70c1b5c7ca66887f014330c6621cb6fb6edbf66ee25afb8e9abfa4b4249b: Status 404 returned error can't find the container with id ef0d70c1b5c7ca66887f014330c6621cb6fb6edbf66ee25afb8e9abfa4b4249b
Jul 18 02:15:56.578002 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:56.577961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx" event={"ID":"082e6715-a4c1-41a9-817a-49cb7e98e291","Type":"ContainerStarted","Data":"ef0d70c1b5c7ca66887f014330c6621cb6fb6edbf66ee25afb8e9abfa4b4249b"}
Jul 18 02:15:57.584269 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:57.584227    2562 generic.go:356] "Generic (PLEG): container finished" podID="082e6715-a4c1-41a9-817a-49cb7e98e291" containerID="61270632a5740fb2dd6fe21e8a9e2fd94ff61afd458dad6b4291a4ba0468ed12" exitCode=0
Jul 18 02:15:57.584700 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:57.584306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx" event={"ID":"082e6715-a4c1-41a9-817a-49cb7e98e291","Type":"ContainerDied","Data":"61270632a5740fb2dd6fe21e8a9e2fd94ff61afd458dad6b4291a4ba0468ed12"}
Jul 18 02:15:58.723698 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:58.723673    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"
Jul 18 02:15:58.810947 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:58.810907    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/082e6715-a4c1-41a9-817a-49cb7e98e291-maas-api-service-ca\") pod \"082e6715-a4c1-41a9-817a-49cb7e98e291\" (UID: \"082e6715-a4c1-41a9-817a-49cb7e98e291\") "
Jul 18 02:15:58.811270 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:58.811250    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082e6715-a4c1-41a9-817a-49cb7e98e291-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "082e6715-a4c1-41a9-817a-49cb7e98e291" (UID: "082e6715-a4c1-41a9-817a-49cb7e98e291"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:15:58.912649 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:58.912561    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/082e6715-a4c1-41a9-817a-49cb7e98e291-maas-api-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:15:59.596800 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:59.596759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx" event={"ID":"082e6715-a4c1-41a9-817a-49cb7e98e291","Type":"ContainerDied","Data":"ef0d70c1b5c7ca66887f014330c6621cb6fb6edbf66ee25afb8e9abfa4b4249b"}
Jul 18 02:15:59.596989 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:59.596817    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef0d70c1b5c7ca66887f014330c6621cb6fb6edbf66ee25afb8e9abfa4b4249b"
Jul 18 02:15:59.596989 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:15:59.596776    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"
Jul 18 02:16:06.314663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:06.314627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:10.998991 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:10.998955    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"]
Jul 18 02:16:11.001757 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.001723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:11.001894 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.001783    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d45c47d8-sg8tx"]
Jul 18 02:16:11.132020 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.131986    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"]
Jul 18 02:16:11.132238 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.132193    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy" containerID="cri-o://4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91" gracePeriod=30
Jul 18 02:16:11.161084 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.161052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:11.382542 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.382448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:11.621732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.621703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:11.915098 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.915065    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"]
Jul 18 02:16:11.915677 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.915641    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="082e6715-a4c1-41a9-817a-49cb7e98e291" containerName="revoke-keys"
Jul 18 02:16:11.915677 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.915665    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="082e6715-a4c1-41a9-817a-49cb7e98e291" containerName="revoke-keys"
Jul 18 02:16:11.915848 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.915767    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="082e6715-a4c1-41a9-817a-49cb7e98e291" containerName="revoke-keys"
Jul 18 02:16:11.917802 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.917785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.920123 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.920103    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3a2f16f8-openshift-default-dockercfg-hmnkt\""
Jul 18 02:16:11.923995 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.923961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-socket\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924125 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istiod-ca-cert\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924125 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-data\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924125 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-credential-socket\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924125 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-podinfo\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924309 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwnf4\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-kube-api-access-xwnf4\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924309 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-token\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924430 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-envoy\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.924430 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.924382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-certs\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:11.931226 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.931202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"]
Jul 18 02:16:11.938516 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:11.938481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:12.024818 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.024782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-certs\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.024836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-socket\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.024866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istiod-ca-cert\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.024892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-data\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.024919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-credential-socket\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.024957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-podinfo\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwnf4\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-kube-api-access-xwnf4\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-token\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-envoy\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025314    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-certs\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025434    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-data\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-credential-socket\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025583    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-socket\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.025849 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.025714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istiod-ca-cert\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.027516 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.027491    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-envoy\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.027642 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.027625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-podinfo\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.033042 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.033011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-token\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.033281 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.033264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwnf4\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-kube-api-access-xwnf4\") pod \"e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") " pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.196875 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.196767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:12.229305 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.229260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:12.374584 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.374554    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"]
Jul 18 02:16:12.377234 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:16:12.377207    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf029d96a_4faa_4e55_82b4_f2404d1a05e5.slice/crio-faefd5d743c6af4d9cc275f26a88c7968ea3a71a1b2aa352c098b3a2e85209a0 WatchSource:0}: Error finding container faefd5d743c6af4d9cc275f26a88c7968ea3a71a1b2aa352c098b3a2e85209a0: Status 404 returned error can't find the container with id faefd5d743c6af4d9cc275f26a88c7968ea3a71a1b2aa352c098b3a2e85209a0
Jul 18 02:16:12.379418 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.379384    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:12.379522 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.379454    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:12.379522 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.379485    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:12.539223 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.539175    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="082e6715-a4c1-41a9-817a-49cb7e98e291" path="/var/lib/kubelet/pods/082e6715-a4c1-41a9-817a-49cb7e98e291/volumes"
Jul 18 02:16:12.662018 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.661974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" event={"ID":"f029d96a-4faa-4e55-82b4-f2404d1a05e5","Type":"ContainerStarted","Data":"bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e"}
Jul 18 02:16:12.662211 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:12.662048    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" event={"ID":"f029d96a-4faa-4e55-82b4-f2404d1a05e5","Type":"ContainerStarted","Data":"faefd5d743c6af4d9cc275f26a88c7968ea3a71a1b2aa352c098b3a2e85209a0"}
Jul 18 02:16:13.230444 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:13.230398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:13.235306 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:13.235268    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:13.256341 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:13.256281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" podStartSLOduration=2.256263471 podStartE2EDuration="2.256263471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:16:12.698561864 +0000 UTC m=+1680.097961524" watchObservedRunningTime="2026-07-18 02:16:13.256263471 +0000 UTC m=+1680.655663130"
Jul 18 02:16:13.667030 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:13.667003    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:13.667996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:13.667977    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:14.049412 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.049380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:14.123030 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.122932    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"]
Jul 18 02:16:14.125798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.125753    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.126007 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.125848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:14.128312 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.128290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3a2f16f8-serving-cert\""
Jul 18 02:16:14.128464 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.128294    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sfxcd\""
Jul 18 02:16:14.142646 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.142608    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"]
Jul 18 02:16:14.150673 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.150643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-openshift-service-ca\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.150861 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.150771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.150861 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.150851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-kube-api-access-2cv7w\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.189701 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.189669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:14.252155 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.252113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-openshift-service-ca\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.252669 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.252203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.252669 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.252238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-kube-api-access-2cv7w\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.252669 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:16:14.252410    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-serving-cert: secret "maas-api-e2e-ait-3a2f16f8-serving-cert" not found
Jul 18 02:16:14.252669 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:16:14.252491    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls podName:c017a5e8-2c2c-4bd8-bc5f-e517fd111401 nodeName:}" failed. No retries permitted until 2026-07-18 02:16:14.752467768 +0000 UTC m=+1682.151867425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls") pod "maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff" (UID: "c017a5e8-2c2c-4bd8-bc5f-e517fd111401") : secret "maas-api-e2e-ait-3a2f16f8-serving-cert" not found
Jul 18 02:16:14.252849 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.252767    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-openshift-service-ca\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.260973 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.260949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-kube-api-access-2cv7w\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.388580 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.388485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:14.688947 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.688853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:14.757695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.757655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.760109 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.760079    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls\") pod \"maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:14.789929 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:14.789888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:15.038758 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:15.038719    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:15.177045 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:15.177008    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"]
Jul 18 02:16:15.177181 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:16:15.177006    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc017a5e8_2c2c_4bd8_bc5f_e517fd111401.slice/crio-7540fb0cd17f09a5fc7e61a8d1cecf3ce3e8dded2971af46fd0c4b431b29ecb7 WatchSource:0}: Error finding container 7540fb0cd17f09a5fc7e61a8d1cecf3ce3e8dded2971af46fd0c4b431b29ecb7: Status 404 returned error can't find the container with id 7540fb0cd17f09a5fc7e61a8d1cecf3ce3e8dded2971af46fd0c4b431b29ecb7
Jul 18 02:16:15.678935 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:15.678900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff" event={"ID":"c017a5e8-2c2c-4bd8-bc5f-e517fd111401","Type":"ContainerStarted","Data":"7540fb0cd17f09a5fc7e61a8d1cecf3ce3e8dded2971af46fd0c4b431b29ecb7"}
Jul 18 02:16:16.392377 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.392280    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:16:16.472860 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.472817    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-credential-socket\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473041 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.472884    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d67116-4c12-498c-afe4-52ac8a801924-istio-podinfo\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473041 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.472918    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-data\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473041 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.472937    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d67116-4c12-498c-afe4-52ac8a801924-istiod-ca-cert\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473041 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.472989    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8bc5\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-kube-api-access-n8bc5\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473041 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473011    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-certs\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473041 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473033    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-envoy\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473407 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473078    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-istio-token\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473407 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473131    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-socket\") pod \"20d67116-4c12-498c-afe4-52ac8a801924\" (UID: \"20d67116-4c12-498c-afe4-52ac8a801924\") "
Jul 18 02:16:16.473407 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473139    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:16.473572 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473428    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20d67116-4c12-498c-afe4-52ac8a801924-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:16:16.473572 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473452    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.473753 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473706    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:16.473812 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473748    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:16.473985 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.473960    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-data" (OuterVolumeSpecName: "istio-data") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:16.475419 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.475393    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20d67116-4c12-498c-afe4-52ac8a801924-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:16:16.475497 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.475419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:16:16.475633 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.475610    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-kube-api-access-n8bc5" (OuterVolumeSpecName: "kube-api-access-n8bc5") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "kube-api-access-n8bc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:16:16.475699 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.475643    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-istio-token" (OuterVolumeSpecName: "istio-token") pod "20d67116-4c12-498c-afe4-52ac8a801924" (UID: "20d67116-4c12-498c-afe4-52ac8a801924"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:16:16.574482 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574444    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8bc5\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-kube-api-access-n8bc5\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.574482 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574477    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.574482 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574487    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.574482 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574495    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d67116-4c12-498c-afe4-52ac8a801924-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.574761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574504    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.574761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574511    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d67116-4c12-498c-afe4-52ac8a801924-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.574761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574519    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d67116-4c12-498c-afe4-52ac8a801924-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.574761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.574527    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d67116-4c12-498c-afe4-52ac8a801924-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:16.685556 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.685459    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff" event={"ID":"c017a5e8-2c2c-4bd8-bc5f-e517fd111401","Type":"ContainerStarted","Data":"3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504"}
Jul 18 02:16:16.685994 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.685556    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:16.687295 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.687273    2562 generic.go:356] "Generic (PLEG): container finished" podID="20d67116-4c12-498c-afe4-52ac8a801924" containerID="4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91" exitCode=0
Jul 18 02:16:16.687417 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.687301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" event={"ID":"20d67116-4c12-498c-afe4-52ac8a801924","Type":"ContainerDied","Data":"4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91"}
Jul 18 02:16:16.687417 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.687318    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"
Jul 18 02:16:16.687417 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.687356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn" event={"ID":"20d67116-4c12-498c-afe4-52ac8a801924","Type":"ContainerDied","Data":"3d1346fa606fbbc496ab8a32c04b38093481163a291cfe293c3145d9c43e865f"}
Jul 18 02:16:16.687417 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.687379    2562 scope.go:117] "RemoveContainer" containerID="4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91"
Jul 18 02:16:16.696355 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.696336    2562 scope.go:117] "RemoveContainer" containerID="f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359"
Jul 18 02:16:16.702803 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.702737    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff" podStartSLOduration=2.242808036 podStartE2EDuration="2.702718857s" totalImagesPullingTime="459.910821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:16:16.701649566 +0000 UTC m=+1684.101049247" watchObservedRunningTime="2026-07-18 02:16:16.702718857 +0000 UTC m=+1684.102118515"
Jul 18 02:16:16.706153 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.705885    2562 scope.go:117] "RemoveContainer" containerID="4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91"
Jul 18 02:16:16.706251 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:16:16.706224    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91\": container with ID starting with 4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91 not found: ID does not exist" containerID="4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91"
Jul 18 02:16:16.706294 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.706254    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91"} err="failed to get container status \"4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91\": rpc error: code = NotFound desc = could not find container \"4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91\": container with ID starting with 4ee0e9d6605bbb6689833b5c3b75c439e5c073b65aca323d505bbb77779a8d91 not found: ID does not exist"
Jul 18 02:16:16.706294 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.706272    2562 scope.go:117] "RemoveContainer" containerID="f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359"
Jul 18 02:16:16.706566 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:16:16.706548    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359\": container with ID starting with f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359 not found: ID does not exist" containerID="f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359"
Jul 18 02:16:16.706600 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.706573    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359"} err="failed to get container status \"f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359\": rpc error: code = NotFound desc = could not find container \"f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359\": container with ID starting with f44a5ada38d22869af42fef1399ee075bfa08c5f2db21d212dfb312de431c359 not found: ID does not exist"
Jul 18 02:16:16.714307 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.714276    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"]
Jul 18 02:16:16.718434 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:16.718404    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d45c47d8-gw-openshift-default-6dcf5fdb6c-fx8vn"]
Jul 18 02:16:18.530995 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:18.530960    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d67116-4c12-498c-afe4-52ac8a801924" path="/var/lib/kubelet/pods/20d67116-4c12-498c-afe4-52ac8a801924/volumes"
Jul 18 02:16:22.706062 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:22.706018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:28.668888 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.668853    2562 patch_prober.go:28] interesting pod/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:16:28.669301 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.668920    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:16:28.764020 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.763979    2562 generic.go:356] "Generic (PLEG): container finished" podID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerID="bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e" exitCode=0
Jul 18 02:16:28.764195 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.764046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" event={"ID":"f029d96a-4faa-4e55-82b4-f2404d1a05e5","Type":"ContainerDied","Data":"bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e"}
Jul 18 02:16:28.764520 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.764506    2562 scope.go:117] "RemoveContainer" containerID="bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e"
Jul 18 02:16:28.765529 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.765500    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:28.765663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.765561    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:28.765663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:28.765610    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:29.770841 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:29.770807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" event={"ID":"f029d96a-4faa-4e55-82b4-f2404d1a05e5","Type":"ContainerStarted","Data":"b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49"}
Jul 18 02:16:30.230069 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:30.229968    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:30.230226 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:30.230162    2562 patch_prober.go:28] interesting pod/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:16:30.230273 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:30.230227    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:16:31.229878 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:31.229836    2562 patch_prober.go:28] interesting pod/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:16:31.230264 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:31.229892    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:16:32.230473 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:32.230431    2562 patch_prober.go:28] interesting pod/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:16:32.230870 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:32.230492    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:16:33.230489 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:33.230445    2562 patch_prober.go:28] interesting pod/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 18 02:16:33.230881 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:33.230516    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 18 02:16:34.234633 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:34.234599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:34.235040 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:34.234876    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:34.235675 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:34.235657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:16:39.856233 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.856195    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"]
Jul 18 02:16:39.856751 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.856632    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy"
Jul 18 02:16:39.856751 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.856645    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy"
Jul 18 02:16:39.856751 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.856705    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy"
Jul 18 02:16:39.856751 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.856715    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy"
Jul 18 02:16:39.859503 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.859482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"
Jul 18 02:16:39.862021 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.862002    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5chqh\""
Jul 18 02:16:39.869343 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:39.869293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"]
Jul 18 02:16:40.013113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.013072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e3e923-5a82-4b47-853b-7745f8b6f37e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j\" (UID: \"35e3e923-5a82-4b47-853b-7745f8b6f37e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"
Jul 18 02:16:40.114080 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.113975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e3e923-5a82-4b47-853b-7745f8b6f37e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j\" (UID: \"35e3e923-5a82-4b47-853b-7745f8b6f37e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"
Jul 18 02:16:40.114661 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.114636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e3e923-5a82-4b47-853b-7745f8b6f37e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j\" (UID: \"35e3e923-5a82-4b47-853b-7745f8b6f37e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"
Jul 18 02:16:40.171440 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.171402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"
Jul 18 02:16:40.513295 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.513161    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"]
Jul 18 02:16:40.516635 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:16:40.516604    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e3e923_5a82_4b47_853b_7745f8b6f37e.slice/crio-a550545bf3d2bbf5570fb292dfe74cabbbad8e15a180968eb66c0da83b5a3587 WatchSource:0}: Error finding container a550545bf3d2bbf5570fb292dfe74cabbbad8e15a180968eb66c0da83b5a3587: Status 404 returned error can't find the container with id a550545bf3d2bbf5570fb292dfe74cabbbad8e15a180968eb66c0da83b5a3587
Jul 18 02:16:40.843742 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.843705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j" event={"ID":"35e3e923-5a82-4b47-853b-7745f8b6f37e","Type":"ContainerStarted","Data":"fd9ead055c59b3746119cfe1548389d5b21de6dfbe700d3375e0de7aff4a7350"}
Jul 18 02:16:40.843921 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.843791    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j" event={"ID":"35e3e923-5a82-4b47-853b-7745f8b6f37e","Type":"ContainerStarted","Data":"a550545bf3d2bbf5570fb292dfe74cabbbad8e15a180968eb66c0da83b5a3587"}
Jul 18 02:16:40.859420 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:40.859364    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j" podStartSLOduration=1.859348996 podStartE2EDuration="1.859348996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:16:40.857778218 +0000 UTC m=+1708.257177880" watchObservedRunningTime="2026-07-18 02:16:40.859348996 +0000 UTC m=+1708.258748654"
Jul 18 02:16:41.850745 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:41.850706    2562 generic.go:356] "Generic (PLEG): container finished" podID="35e3e923-5a82-4b47-853b-7745f8b6f37e" containerID="fd9ead055c59b3746119cfe1548389d5b21de6dfbe700d3375e0de7aff4a7350" exitCode=0
Jul 18 02:16:41.850948 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:41.850786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j" event={"ID":"35e3e923-5a82-4b47-853b-7745f8b6f37e","Type":"ContainerDied","Data":"fd9ead055c59b3746119cfe1548389d5b21de6dfbe700d3375e0de7aff4a7350"}
Jul 18 02:16:42.988730 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:42.988703    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"
Jul 18 02:16:43.143605 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:43.143510    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e3e923-5a82-4b47-853b-7745f8b6f37e-maas-api-service-ca\") pod \"35e3e923-5a82-4b47-853b-7745f8b6f37e\" (UID: \"35e3e923-5a82-4b47-853b-7745f8b6f37e\") "
Jul 18 02:16:43.143877 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:43.143854    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e3e923-5a82-4b47-853b-7745f8b6f37e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35e3e923-5a82-4b47-853b-7745f8b6f37e" (UID: "35e3e923-5a82-4b47-853b-7745f8b6f37e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:16:43.245216 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:43.245170    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e3e923-5a82-4b47-853b-7745f8b6f37e-maas-api-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:43.862742 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:43.862710    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"
Jul 18 02:16:43.862899 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:43.862707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j" event={"ID":"35e3e923-5a82-4b47-853b-7745f8b6f37e","Type":"ContainerDied","Data":"a550545bf3d2bbf5570fb292dfe74cabbbad8e15a180968eb66c0da83b5a3587"}
Jul 18 02:16:43.862899 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:43.862835    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a550545bf3d2bbf5570fb292dfe74cabbbad8e15a180968eb66c0da83b5a3587"
Jul 18 02:16:50.242699 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.242658    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"]
Jul 18 02:16:50.243152 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.242876    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff" podUID="c017a5e8-2c2c-4bd8-bc5f-e517fd111401" containerName="maas-api" containerID="cri-o://3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504" gracePeriod=30
Jul 18 02:16:50.265055 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.265012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:50.493364 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.493281    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:50.512715 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.512678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-openshift-service-ca\") pod \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") "
Jul 18 02:16:50.512912 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.512752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-kube-api-access-2cv7w\") pod \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") "
Jul 18 02:16:50.512912 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.512835    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls\") pod \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\" (UID: \"c017a5e8-2c2c-4bd8-bc5f-e517fd111401\") "
Jul 18 02:16:50.513144 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.513101    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c017a5e8-2c2c-4bd8-bc5f-e517fd111401" (UID: "c017a5e8-2c2c-4bd8-bc5f-e517fd111401"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:16:50.515449 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.515416    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-kube-api-access-2cv7w" (OuterVolumeSpecName: "kube-api-access-2cv7w") pod "c017a5e8-2c2c-4bd8-bc5f-e517fd111401" (UID: "c017a5e8-2c2c-4bd8-bc5f-e517fd111401"). InnerVolumeSpecName "kube-api-access-2cv7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:16:50.515602 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.515573    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c017a5e8-2c2c-4bd8-bc5f-e517fd111401" (UID: "c017a5e8-2c2c-4bd8-bc5f-e517fd111401"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:16:50.614445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.614361    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-maas-api-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:50.614445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.614399    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-openshift-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:50.614445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.614415    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cv7w\" (UniqueName: \"kubernetes.io/projected/c017a5e8-2c2c-4bd8-bc5f-e517fd111401-kube-api-access-2cv7w\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:16:50.905958 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.905921    2562 generic.go:356] "Generic (PLEG): container finished" podID="c017a5e8-2c2c-4bd8-bc5f-e517fd111401" containerID="3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504" exitCode=0
Jul 18 02:16:50.905958 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.905964    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"
Jul 18 02:16:50.906202 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.906005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff" event={"ID":"c017a5e8-2c2c-4bd8-bc5f-e517fd111401","Type":"ContainerDied","Data":"3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504"}
Jul 18 02:16:50.906202 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.906052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff" event={"ID":"c017a5e8-2c2c-4bd8-bc5f-e517fd111401","Type":"ContainerDied","Data":"7540fb0cd17f09a5fc7e61a8d1cecf3ce3e8dded2971af46fd0c4b431b29ecb7"}
Jul 18 02:16:50.906202 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.906075    2562 scope.go:117] "RemoveContainer" containerID="3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504"
Jul 18 02:16:50.915482 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.915463    2562 scope.go:117] "RemoveContainer" containerID="3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504"
Jul 18 02:16:50.915748 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:16:50.915728    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504\": container with ID starting with 3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504 not found: ID does not exist" containerID="3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504"
Jul 18 02:16:50.915805 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.915757    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504"} err="failed to get container status \"3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504\": rpc error: code = NotFound desc = could not find container \"3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504\": container with ID starting with 3e6ab026ed449ce1df26f5551e60dfbf9911255e963aa4332111644dab7c6504 not found: ID does not exist"
Jul 18 02:16:50.922020 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.921996    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"]
Jul 18 02:16:50.927752 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:50.927726    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3a2f16f8-7b54496dcb-4gsff"]
Jul 18 02:16:52.531492 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:52.531457    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c017a5e8-2c2c-4bd8-bc5f-e517fd111401" path="/var/lib/kubelet/pods/c017a5e8-2c2c-4bd8-bc5f-e517fd111401/volumes"
Jul 18 02:16:54.926662 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:54.926622    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"]
Jul 18 02:16:54.928442 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:54.928409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:54.929141 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:54.929119    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3a2f16f8-xpv2j"]
Jul 18 02:16:56.080759 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.080719    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"]
Jul 18 02:16:56.081255 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.080988    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy" containerID="cri-o://b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49" gracePeriod=30
Jul 18 02:16:56.100866 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.100827    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:56.318192 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.318158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:56.532906 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.532875    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:56.534548 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.534519    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e3e923-5a82-4b47-853b-7745f8b6f37e" path="/var/lib/kubelet/pods/35e3e923-5a82-4b47-853b-7745f8b6f37e/volumes"
Jul 18 02:16:56.847306 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847220    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"]
Jul 18 02:16:56.847697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847682    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c017a5e8-2c2c-4bd8-bc5f-e517fd111401" containerName="maas-api"
Jul 18 02:16:56.847741 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847699    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c017a5e8-2c2c-4bd8-bc5f-e517fd111401" containerName="maas-api"
Jul 18 02:16:56.847741 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847715    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e3e923-5a82-4b47-853b-7745f8b6f37e" containerName="revoke-keys"
Jul 18 02:16:56.847741 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847720    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e3e923-5a82-4b47-853b-7745f8b6f37e" containerName="revoke-keys"
Jul 18 02:16:56.847741 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847732    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy"
Jul 18 02:16:56.847741 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847737    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d67116-4c12-498c-afe4-52ac8a801924" containerName="istio-proxy"
Jul 18 02:16:56.847895 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847800    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c017a5e8-2c2c-4bd8-bc5f-e517fd111401" containerName="maas-api"
Jul 18 02:16:56.847895 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.847808    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e3e923-5a82-4b47-853b-7745f8b6f37e" containerName="revoke-keys"
Jul 18 02:16:56.850785 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.850767    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.854197 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.854177    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c0b236f4-openshift-default-dockercfg-9n79c\""
Jul 18 02:16:56.868057 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.868024    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"]
Jul 18 02:16:56.874610 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899fe60d-c443-43d6-8a19-43e03c24340b-istiod-ca-cert\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.874796 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-certs\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.874796 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-istio-token\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.874796 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-data\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.874935 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-socket\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.874935 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899fe60d-c443-43d6-8a19-43e03c24340b-istio-podinfo\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.874935 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-envoy\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.874935 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-credential-socket\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.875105 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.874955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprtw\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-kube-api-access-tprtw\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.894381 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.894345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:56.976486 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-data\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-socket\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899fe60d-c443-43d6-8a19-43e03c24340b-istio-podinfo\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-envoy\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-credential-socket\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976859 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprtw\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-kube-api-access-tprtw\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976859 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899fe60d-c443-43d6-8a19-43e03c24340b-istiod-ca-cert\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976960 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-certs\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976960 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976893    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-data\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.976960 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-credential-socket\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.977099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-socket\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.977099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.976985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-istio-token\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.977235 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.977214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-certs\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.977579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.977558    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899fe60d-c443-43d6-8a19-43e03c24340b-istiod-ca-cert\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.979002 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.978982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899fe60d-c443-43d6-8a19-43e03c24340b-istio-podinfo\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.979154 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.979139    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-envoy\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.986965 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.986937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-istio-token\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:56.987085 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:56.987019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprtw\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-kube-api-access-tprtw\") pod \"e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") " pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:57.161301 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.161208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:57.190543 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.190512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:57.302762 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.302735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"]
Jul 18 02:16:57.305441 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:16:57.305412    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899fe60d_c443_43d6_8a19_43e03c24340b.slice/crio-b72b7b0aece38f00ea2854ed0a03ef8e4b898e07b29928971f2b3c068de5a152 WatchSource:0}: Error finding container b72b7b0aece38f00ea2854ed0a03ef8e4b898e07b29928971f2b3c068de5a152: Status 404 returned error can't find the container with id b72b7b0aece38f00ea2854ed0a03ef8e4b898e07b29928971f2b3c068de5a152
Jul 18 02:16:57.307751 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.307715    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:57.307839 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.307806    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:57.307879 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.307851    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:16:57.947791 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.947750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" event={"ID":"899fe60d-c443-43d6-8a19-43e03c24340b","Type":"ContainerStarted","Data":"73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5"}
Jul 18 02:16:57.948009 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.947808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" event={"ID":"899fe60d-c443-43d6-8a19-43e03c24340b","Type":"ContainerStarted","Data":"b72b7b0aece38f00ea2854ed0a03ef8e4b898e07b29928971f2b3c068de5a152"}
Jul 18 02:16:57.968701 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:57.968646    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" podStartSLOduration=1.968630366 podStartE2EDuration="1.968630366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:16:57.966935256 +0000 UTC m=+1725.366334941" watchObservedRunningTime="2026-07-18 02:16:57.968630366 +0000 UTC m=+1725.368030025"
Jul 18 02:16:58.161484 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:58.161447    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:58.166539 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:58.166513    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:58.953747 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:58.953702    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:58.954725 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:58.954702    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:16:59.297017 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.296981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:59.393545 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.393508    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"]
Jul 18 02:16:59.395492 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.395460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:59.396161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.396144    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.398515 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.398494    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-c0b236f4-serving-cert\""
Jul 18 02:16:59.398688 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.398673    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sfxcd\""
Jul 18 02:16:59.408230 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.408204    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"]
Jul 18 02:16:59.467846 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.467794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:59.503849 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.503815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w825\" (UniqueName: \"kubernetes.io/projected/12633279-c1eb-4659-a783-cfbcefadca06-kube-api-access-4w825\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.504026 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.503887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12633279-c1eb-4659-a783-cfbcefadca06-openshift-service-ca\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.504026 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.503917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12633279-c1eb-4659-a783-cfbcefadca06-maas-api-tls\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.574230 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.574139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:16:59.604879 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.604843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w825\" (UniqueName: \"kubernetes.io/projected/12633279-c1eb-4659-a783-cfbcefadca06-kube-api-access-4w825\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.604994 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.604910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12633279-c1eb-4659-a783-cfbcefadca06-openshift-service-ca\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.604994 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.604933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12633279-c1eb-4659-a783-cfbcefadca06-maas-api-tls\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.605702 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.605677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12633279-c1eb-4659-a783-cfbcefadca06-openshift-service-ca\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.607579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.607555    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12633279-c1eb-4659-a783-cfbcefadca06-maas-api-tls\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.612864 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.612835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w825\" (UniqueName: \"kubernetes.io/projected/12633279-c1eb-4659-a783-cfbcefadca06-kube-api-access-4w825\") pod \"maas-api-e2e-derive-c0b236f4-89ff68658-r68d5\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.708247 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.708205    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:16:59.843391 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.843361    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"]
Jul 18 02:16:59.846007 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:16:59.845980    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12633279_c1eb_4659_a783_cfbcefadca06.slice/crio-3c4b156c202ed95495222dd45965428d9c3a6648914341a04d4614c53493fae2 WatchSource:0}: Error finding container 3c4b156c202ed95495222dd45965428d9c3a6648914341a04d4614c53493fae2: Status 404 returned error can't find the container with id 3c4b156c202ed95495222dd45965428d9c3a6648914341a04d4614c53493fae2
Jul 18 02:16:59.960828 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:16:59.960787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5" event={"ID":"12633279-c1eb-4659-a783-cfbcefadca06","Type":"ContainerStarted","Data":"3c4b156c202ed95495222dd45965428d9c3a6648914341a04d4614c53493fae2"}
Jul 18 02:17:00.047550 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:00.047513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:00.153377 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:00.153270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:00.967882 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:00.967828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5" event={"ID":"12633279-c1eb-4659-a783-cfbcefadca06","Type":"ContainerStarted","Data":"faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139"}
Jul 18 02:17:00.968444 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:00.968158    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:17:00.984198 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:00.984141    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5" podStartSLOduration=1.5974147269999999 podStartE2EDuration="1.984123419s" totalImagesPullingTime="386.708692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:17:00.983182633 +0000 UTC m=+1728.382582312" watchObservedRunningTime="2026-07-18 02:17:00.984123419 +0000 UTC m=+1728.383523077"
Jul 18 02:17:01.336834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.336809    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:17:01.424384 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424308    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-certs\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istiod-ca-cert\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424463    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwnf4\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-kube-api-access-xwnf4\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424492    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-credential-socket\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424512    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-token\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424528    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-envoy\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424579 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424565    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-podinfo\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424898 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424604    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-socket\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424898 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424634    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:01.424898 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424702    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-data\") pod \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\" (UID: \"f029d96a-4faa-4e55-82b4-f2404d1a05e5\") "
Jul 18 02:17:01.424898 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424826    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:01.424898 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.424876    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:17:01.425154 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.425078    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.425154 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.425096    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.425154 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.425106    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.425348 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.425172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:01.425684 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.425652    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:01.426818 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.426794    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:01.426818 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.426814    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-kube-api-access-xwnf4" (OuterVolumeSpecName: "kube-api-access-xwnf4") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "kube-api-access-xwnf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:17:01.426936 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.426916    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:17:01.426993 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.426979    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f029d96a-4faa-4e55-82b4-f2404d1a05e5" (UID: "f029d96a-4faa-4e55-82b4-f2404d1a05e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:17:01.525950 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.525857    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.525950 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.525890    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.525950 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.525899    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwnf4\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-kube-api-access-xwnf4\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.525950 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.525909    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.525950 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.525918    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.525950 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.525925    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f029d96a-4faa-4e55-82b4-f2404d1a05e5-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:01.984977 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.984873    2562 generic.go:356] "Generic (PLEG): container finished" podID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerID="b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49" exitCode=0
Jul 18 02:17:01.984977 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.984933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"
Jul 18 02:17:01.984977 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.984963    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" event={"ID":"f029d96a-4faa-4e55-82b4-f2404d1a05e5","Type":"ContainerDied","Data":"b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49"}
Jul 18 02:17:01.985513 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.985034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh" event={"ID":"f029d96a-4faa-4e55-82b4-f2404d1a05e5","Type":"ContainerDied","Data":"faefd5d743c6af4d9cc275f26a88c7968ea3a71a1b2aa352c098b3a2e85209a0"}
Jul 18 02:17:01.985513 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.985055    2562 scope.go:117] "RemoveContainer" containerID="b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49"
Jul 18 02:17:01.994363 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:01.994315    2562 scope.go:117] "RemoveContainer" containerID="bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e"
Jul 18 02:17:02.002857 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:02.002836    2562 scope.go:117] "RemoveContainer" containerID="b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49"
Jul 18 02:17:02.003136 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:17:02.003114    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49\": container with ID starting with b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49 not found: ID does not exist" containerID="b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49"
Jul 18 02:17:02.003180 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:02.003148    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49"} err="failed to get container status \"b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49\": rpc error: code = NotFound desc = could not find container \"b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49\": container with ID starting with b7b063f8820d7a6bf28c0820ff864ad2b5c18a5623d60e18dfef7888fe4a2f49 not found: ID does not exist"
Jul 18 02:17:02.003229 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:02.003178    2562 scope.go:117] "RemoveContainer" containerID="bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e"
Jul 18 02:17:02.003479 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:17:02.003454    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e\": container with ID starting with bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e not found: ID does not exist" containerID="bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e"
Jul 18 02:17:02.003518 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:02.003490    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e"} err="failed to get container status \"bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e\": rpc error: code = NotFound desc = could not find container \"bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e\": container with ID starting with bbec8d16a6a33d98316541814ad2e1134ef2c3a7f50fec21146c3075c249541e not found: ID does not exist"
Jul 18 02:17:02.006604 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:02.006579    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"]
Jul 18 02:17:02.010460 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:02.010437    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3a2f16f8-openshift-default-6f88549f45-klsxh"]
Jul 18 02:17:02.530886 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:02.530856    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" path="/var/lib/kubelet/pods/f029d96a-4faa-4e55-82b4-f2404d1a05e5/volumes"
Jul 18 02:17:06.998694 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:06.998636    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:17:11.043642 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:11.043607    2562 generic.go:356] "Generic (PLEG): container finished" podID="899fe60d-c443-43d6-8a19-43e03c24340b" containerID="73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5" exitCode=0
Jul 18 02:17:11.044180 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:11.043691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" event={"ID":"899fe60d-c443-43d6-8a19-43e03c24340b","Type":"ContainerDied","Data":"73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5"}
Jul 18 02:17:11.044253 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:11.044202    2562 scope.go:117] "RemoveContainer" containerID="73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5"
Jul 18 02:17:11.045248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:11.045223    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:17:11.045307 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:11.045295    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:17:11.045364 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:11.045353    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:17:12.051073 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:12.051040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" event={"ID":"899fe60d-c443-43d6-8a19-43e03c24340b","Type":"ContainerStarted","Data":"0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4"}
Jul 18 02:17:12.161767 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:12.161727    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:17:12.163161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:12.163127    2562 patch_prober.go:28] interesting pod/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 18 02:17:12.163339 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:12.163192    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 18 02:17:13.162586 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:13.162548    2562 patch_prober.go:28] interesting pod/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 18 02:17:13.163017 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:13.162602    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 18 02:17:13.954133 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:13.954093    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:17:14.162175 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:14.162136    2562 patch_prober.go:28] interesting pod/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 18 02:17:14.162373 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:14.162204    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 18 02:17:14.608208 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:14.608162    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:14.710022 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:14.709973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:15.162148 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:15.162107    2562 patch_prober.go:28] interesting pod/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 18 02:17:15.162368 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:15.162199    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 18 02:17:16.165460 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:16.165428    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:17:16.166537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:16.166514    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:17:34.692051 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.692016    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"]
Jul 18 02:17:34.692660 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.692240    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5" podUID="12633279-c1eb-4659-a783-cfbcefadca06" containerName="maas-api" containerID="cri-o://faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139" gracePeriod=30
Jul 18 02:17:34.723921 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.723884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:34.940544 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.940518    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:17:34.965001 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.964916    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12633279-c1eb-4659-a783-cfbcefadca06-openshift-service-ca\") pod \"12633279-c1eb-4659-a783-cfbcefadca06\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") "
Jul 18 02:17:34.965001 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.964994    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w825\" (UniqueName: \"kubernetes.io/projected/12633279-c1eb-4659-a783-cfbcefadca06-kube-api-access-4w825\") pod \"12633279-c1eb-4659-a783-cfbcefadca06\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") "
Jul 18 02:17:34.965228 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.965054    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12633279-c1eb-4659-a783-cfbcefadca06-maas-api-tls\") pod \"12633279-c1eb-4659-a783-cfbcefadca06\" (UID: \"12633279-c1eb-4659-a783-cfbcefadca06\") "
Jul 18 02:17:34.965318 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.965294    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12633279-c1eb-4659-a783-cfbcefadca06-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12633279-c1eb-4659-a783-cfbcefadca06" (UID: "12633279-c1eb-4659-a783-cfbcefadca06"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:17:34.967204 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.967179    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12633279-c1eb-4659-a783-cfbcefadca06-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12633279-c1eb-4659-a783-cfbcefadca06" (UID: "12633279-c1eb-4659-a783-cfbcefadca06"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:17:34.967315 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:34.967292    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12633279-c1eb-4659-a783-cfbcefadca06-kube-api-access-4w825" (OuterVolumeSpecName: "kube-api-access-4w825") pod "12633279-c1eb-4659-a783-cfbcefadca06" (UID: "12633279-c1eb-4659-a783-cfbcefadca06"). InnerVolumeSpecName "kube-api-access-4w825". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:17:35.066779 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.066732    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12633279-c1eb-4659-a783-cfbcefadca06-openshift-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:35.066779 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.066766    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w825\" (UniqueName: \"kubernetes.io/projected/12633279-c1eb-4659-a783-cfbcefadca06-kube-api-access-4w825\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:35.066779 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.066776    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12633279-c1eb-4659-a783-cfbcefadca06-maas-api-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:35.175660 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.175626    2562 generic.go:356] "Generic (PLEG): container finished" podID="12633279-c1eb-4659-a783-cfbcefadca06" containerID="faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139" exitCode=0
Jul 18 02:17:35.175825 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.175669    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"
Jul 18 02:17:35.175825 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.175688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5" event={"ID":"12633279-c1eb-4659-a783-cfbcefadca06","Type":"ContainerDied","Data":"faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139"}
Jul 18 02:17:35.175825 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.175731    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5" event={"ID":"12633279-c1eb-4659-a783-cfbcefadca06","Type":"ContainerDied","Data":"3c4b156c202ed95495222dd45965428d9c3a6648914341a04d4614c53493fae2"}
Jul 18 02:17:35.175825 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.175754    2562 scope.go:117] "RemoveContainer" containerID="faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139"
Jul 18 02:17:35.185043 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.185020    2562 scope.go:117] "RemoveContainer" containerID="faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139"
Jul 18 02:17:35.185376 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:17:35.185355    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139\": container with ID starting with faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139 not found: ID does not exist" containerID="faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139"
Jul 18 02:17:35.185444 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.185384    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139"} err="failed to get container status \"faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139\": rpc error: code = NotFound desc = could not find container \"faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139\": container with ID starting with faa635c69d657a8fbfc6020710e3a22a0ec72282243ff98401f1d02f9d33a139 not found: ID does not exist"
Jul 18 02:17:35.196107 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.196074    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"]
Jul 18 02:17:35.199678 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:35.199648    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-c0b236f4-89ff68658-r68d5"]
Jul 18 02:17:36.531073 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:36.531037    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12633279-c1eb-4659-a783-cfbcefadca06" path="/var/lib/kubelet/pods/12633279-c1eb-4659-a783-cfbcefadca06/volumes"
Jul 18 02:17:39.245074 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:39.245041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:39.386845 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:39.386813    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"]
Jul 18 02:17:39.387038 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:39.387017    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy" containerID="cri-o://0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4" gracePeriod=30
Jul 18 02:17:39.406778 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:39.406722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:39.642958 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:39.642926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:40.119732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:40.119701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:40.217919 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:40.217885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:40.318111 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:40.318074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:41.743224 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:41.743182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:42.011084 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:42.011043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:42.111920 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:42.111887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:44.640859 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.640834    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:17:44.761527 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761497    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tprtw\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-kube-api-access-tprtw\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-credential-socket\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-istio-token\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761617    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-certs\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761636    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-envoy\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761676    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899fe60d-c443-43d6-8a19-43e03c24340b-istiod-ca-cert\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761941 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761737    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-data\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761941 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761771    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899fe60d-c443-43d6-8a19-43e03c24340b-istio-podinfo\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.761941 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761796    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-socket\") pod \"899fe60d-c443-43d6-8a19-43e03c24340b\" (UID: \"899fe60d-c443-43d6-8a19-43e03c24340b\") "
Jul 18 02:17:44.762106 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761945    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:44.762165 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.762153    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.762228 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.762167    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:44.762275 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.762211    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/899fe60d-c443-43d6-8a19-43e03c24340b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:17:44.762468 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.761957    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:44.762681 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.762661    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-data" (OuterVolumeSpecName: "istio-data") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:44.763989 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.763949    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:17:44.764086 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.764009    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/899fe60d-c443-43d6-8a19-43e03c24340b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:17:44.764282 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.764260    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-kube-api-access-tprtw" (OuterVolumeSpecName: "kube-api-access-tprtw") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "kube-api-access-tprtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:17:44.764397 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.764279    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-istio-token" (OuterVolumeSpecName: "istio-token") pod "899fe60d-c443-43d6-8a19-43e03c24340b" (UID: "899fe60d-c443-43d6-8a19-43e03c24340b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:17:44.863092 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863050    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tprtw\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-kube-api-access-tprtw\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.863092 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863087    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.863092 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863096    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/899fe60d-c443-43d6-8a19-43e03c24340b-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.863372 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863106    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.863372 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863114    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/899fe60d-c443-43d6-8a19-43e03c24340b-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.863372 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863121    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.863372 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863129    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/899fe60d-c443-43d6-8a19-43e03c24340b-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:44.863372 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:44.863136    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/899fe60d-c443-43d6-8a19-43e03c24340b-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:17:45.229931 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.229839    2562 generic.go:356] "Generic (PLEG): container finished" podID="899fe60d-c443-43d6-8a19-43e03c24340b" containerID="0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4" exitCode=0
Jul 18 02:17:45.229931 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.229896    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"
Jul 18 02:17:45.229931 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.229919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" event={"ID":"899fe60d-c443-43d6-8a19-43e03c24340b","Type":"ContainerDied","Data":"0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4"}
Jul 18 02:17:45.230172 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.229988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5" event={"ID":"899fe60d-c443-43d6-8a19-43e03c24340b","Type":"ContainerDied","Data":"b72b7b0aece38f00ea2854ed0a03ef8e4b898e07b29928971f2b3c068de5a152"}
Jul 18 02:17:45.230172 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.230019    2562 scope.go:117] "RemoveContainer" containerID="0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4"
Jul 18 02:17:45.245853 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.245830    2562 scope.go:117] "RemoveContainer" containerID="73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5"
Jul 18 02:17:45.254817 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.254792    2562 scope.go:117] "RemoveContainer" containerID="0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4"
Jul 18 02:17:45.255101 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:17:45.255082    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4\": container with ID starting with 0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4 not found: ID does not exist" containerID="0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4"
Jul 18 02:17:45.255176 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.255110    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4"} err="failed to get container status \"0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4\": rpc error: code = NotFound desc = could not find container \"0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4\": container with ID starting with 0f62daccb932151eefaa843c27657452f72890ce8f6ab17ce97bd5ba40bd88c4 not found: ID does not exist"
Jul 18 02:17:45.255176 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.255128    2562 scope.go:117] "RemoveContainer" containerID="73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5"
Jul 18 02:17:45.255416 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:17:45.255397    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5\": container with ID starting with 73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5 not found: ID does not exist" containerID="73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5"
Jul 18 02:17:45.255502 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.255420    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5"} err="failed to get container status \"73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5\": rpc error: code = NotFound desc = could not find container \"73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5\": container with ID starting with 73f033487b5683d7019cf1a6001aaf7d8cc28be85703e1832474b9c37a7c6cc5 not found: ID does not exist"
Jul 18 02:17:45.255996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.255974    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"]
Jul 18 02:17:45.260216 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:45.260179    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c0b236f4-openshift-default-585f5dd8d7-rbll5"]
Jul 18 02:17:46.531625 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:46.531590    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" path="/var/lib/kubelet/pods/899fe60d-c443-43d6-8a19-43e03c24340b/volumes"
Jul 18 02:17:47.464594 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:47.464556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:47.536498 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:47.536457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:47.623795 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:47.623758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:47.727898 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:47.727808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:47.828272 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:47.828237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:17:48.161450 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:17:48.161412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:14.109358 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:14.109304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:20.309299 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:20.309262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:20.410752 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:20.410690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:20.510001 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:20.509961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:36.380285 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:36.380236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:42.509635 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:42.509594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:42.616451 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:42.616400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:42.742546 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:42.742515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:53.326934 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:53.326869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:18:54.041389 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:18:54.041348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:01.012230 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:01.012188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:01.116744 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:01.116697    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:01.212036 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:01.211997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:01.315052 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:01.314946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:02.102446 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:02.102409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:02.204514 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:02.204482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:02.303992 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:02.303950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:03.891232 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:03.891194    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:10.064982 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:10.064945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:10.163680 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:10.163644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:10.720783 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:10.720741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:17.188252 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.188221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:17.290819 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.290765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:17.402770 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.402738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:17.704734 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.704696    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"]
Jul 18 02:19:17.705069 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705057    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy"
Jul 18 02:19:17.705113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705071    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy"
Jul 18 02:19:17.705113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705088    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy"
Jul 18 02:19:17.705113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705093    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy"
Jul 18 02:19:17.705113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705105    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy"
Jul 18 02:19:17.705113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705111    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy"
Jul 18 02:19:17.705268 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705126    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12633279-c1eb-4659-a783-cfbcefadca06" containerName="maas-api"
Jul 18 02:19:17.705268 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705132    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12633279-c1eb-4659-a783-cfbcefadca06" containerName="maas-api"
Jul 18 02:19:17.705268 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705186    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy"
Jul 18 02:19:17.705268 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705194    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy"
Jul 18 02:19:17.705268 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.705202    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="12633279-c1eb-4659-a783-cfbcefadca06" containerName="maas-api"
Jul 18 02:19:17.708285 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.708265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.710756 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.710730    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 02:19:17.710912 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.710895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-59ca50e9-openshift-default-dockercfg-klr7k\""
Jul 18 02:19:17.732402 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.732368    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"]
Jul 18 02:19:17.738415 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.738377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:17.854961 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.854914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-envoy\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.854971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-token\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.855003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-podinfo\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.855034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jpdc\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-kube-api-access-5jpdc\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.855066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-socket\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.855106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-data\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855161 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.855149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-credential-socket\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855401 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.855166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-certs\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.855401 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.855263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istiod-ca-cert\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.955765 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jpdc\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-kube-api-access-5jpdc\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.955765 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-socket\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.955765 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-data\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956080 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-credential-socket\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956080 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-certs\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956080 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istiod-ca-cert\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956080 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-envoy\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956080 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-token\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956080 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.955933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-podinfo\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956435 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.956193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-data\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956435 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.956363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-socket\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956551 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.956499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-certs\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956551 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.956540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-credential-socket\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.956675 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.956625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istiod-ca-cert\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.958386 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.958357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-envoy\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.958600 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.958577    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-podinfo\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.964589 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.964556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-token\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.964744 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.964623    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jpdc\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-kube-api-access-5jpdc\") pod \"e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") " pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:17.987689 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:17.987653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:18.018577 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.018539    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:18.165732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.165606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"]
Jul 18 02:19:18.168084 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:19:18.168050    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03930a7_f5f7_4964_b85d_fbef8614f6e5.slice/crio-535c4e3892c55559146603cc3a180a7f438288eff8062f488e94373a127b3571 WatchSource:0}: Error finding container 535c4e3892c55559146603cc3a180a7f438288eff8062f488e94373a127b3571: Status 404 returned error can't find the container with id 535c4e3892c55559146603cc3a180a7f438288eff8062f488e94373a127b3571
Jul 18 02:19:18.170686 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.170652    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:19:18.170787 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.170720    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:19:18.170787 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.170747    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:19:18.692997 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.692959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" event={"ID":"c03930a7-f5f7-4964-b85d-fbef8614f6e5","Type":"ContainerStarted","Data":"a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a"}
Jul 18 02:19:18.693435 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.693020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" event={"ID":"c03930a7-f5f7-4964-b85d-fbef8614f6e5","Type":"ContainerStarted","Data":"535c4e3892c55559146603cc3a180a7f438288eff8062f488e94373a127b3571"}
Jul 18 02:19:18.713653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:18.713585    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" podStartSLOduration=1.713566444 podStartE2EDuration="1.713566444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:19:18.713176197 +0000 UTC m=+1866.112575894" watchObservedRunningTime="2026-07-18 02:19:18.713566444 +0000 UTC m=+1866.112966102"
Jul 18 02:19:19.019133 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:19.019086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:19.025592 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:19.025559    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:19.703978 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:19.703887    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:19.704967 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:19.704947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:20.720669 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.720629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:20.821730 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.821687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:20.825057 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.825025    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"]
Jul 18 02:19:20.825695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.825664    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy"
Jul 18 02:19:20.825695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.825687    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy"
Jul 18 02:19:20.825838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.825808    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f029d96a-4faa-4e55-82b4-f2404d1a05e5" containerName="istio-proxy"
Jul 18 02:19:20.825838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.825820    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="899fe60d-c443-43d6-8a19-43e03c24340b" containerName="istio-proxy"
Jul 18 02:19:20.829416 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.829399    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.831471 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.831445    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-59ca50e9-serving-cert\""
Jul 18 02:19:20.831580 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.831478    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sfxcd\""
Jul 18 02:19:20.840141 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.840118    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"]
Jul 18 02:19:20.884873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.884838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f84d69-b02c-4534-953e-9308ae58565f-maas-api-tls\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.884873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.884875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v42z\" (UniqueName: \"kubernetes.io/projected/c4f84d69-b02c-4534-953e-9308ae58565f-kube-api-access-6v42z\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.885099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.884994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f84d69-b02c-4534-953e-9308ae58565f-openshift-service-ca\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.920361 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.920286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:20.986171 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.986072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f84d69-b02c-4534-953e-9308ae58565f-maas-api-tls\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.986171 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.986110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v42z\" (UniqueName: \"kubernetes.io/projected/c4f84d69-b02c-4534-953e-9308ae58565f-kube-api-access-6v42z\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.986433 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.986189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f84d69-b02c-4534-953e-9308ae58565f-openshift-service-ca\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.986910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.986889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f84d69-b02c-4534-953e-9308ae58565f-openshift-service-ca\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.988830 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.988809    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f84d69-b02c-4534-953e-9308ae58565f-maas-api-tls\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:20.994432 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:20.994410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v42z\" (UniqueName: \"kubernetes.io/projected/c4f84d69-b02c-4534-953e-9308ae58565f-kube-api-access-6v42z\") pod \"maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:21.062065 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:21.062010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:21.142351 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:21.142289    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:21.281472 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:21.281443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"]
Jul 18 02:19:21.283640 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:19:21.283611    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f84d69_b02c_4534_953e_9308ae58565f.slice/crio-5eab2a36f885c18a7d5dcda78afee3e1f2d5fbbca65a26b5dd0b66cc3d37e634 WatchSource:0}: Error finding container 5eab2a36f885c18a7d5dcda78afee3e1f2d5fbbca65a26b5dd0b66cc3d37e634: Status 404 returned error can't find the container with id 5eab2a36f885c18a7d5dcda78afee3e1f2d5fbbca65a26b5dd0b66cc3d37e634
Jul 18 02:19:21.512156 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:21.512126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:21.614412 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:21.614311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:21.716801 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:21.716770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz" event={"ID":"c4f84d69-b02c-4534-953e-9308ae58565f","Type":"ContainerStarted","Data":"5eab2a36f885c18a7d5dcda78afee3e1f2d5fbbca65a26b5dd0b66cc3d37e634"}
Jul 18 02:19:22.724795 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:22.724753    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz" event={"ID":"c4f84d69-b02c-4534-953e-9308ae58565f","Type":"ContainerStarted","Data":"23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc"}
Jul 18 02:19:22.725171 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:22.724856    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:22.742548 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:22.742495    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz" podStartSLOduration=2.334583967 podStartE2EDuration="2.742479536s" totalImagesPullingTime="407.895569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:19:22.741105012 +0000 UTC m=+1870.140504672" watchObservedRunningTime="2026-07-18 02:19:22.742479536 +0000 UTC m=+1870.141879194"
Jul 18 02:19:25.127138 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:25.127096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:25.748065 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:25.748022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:25.849714 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:25.849673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:26.252237 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:26.252204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:28.736143 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:28.736110    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:31.966568 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:31.966532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:32.066417 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:32.066380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:33.786557 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:33.786524    2562 generic.go:356] "Generic (PLEG): container finished" podID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerID="a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a" exitCode=0
Jul 18 02:19:33.786985 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:33.786590    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" event={"ID":"c03930a7-f5f7-4964-b85d-fbef8614f6e5","Type":"ContainerDied","Data":"a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a"}
Jul 18 02:19:33.786985 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:33.786967    2562 scope.go:117] "RemoveContainer" containerID="a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a"
Jul 18 02:19:33.788058 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:33.788031    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:19:33.788124 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:33.788114    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:19:33.788160 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:33.788142    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:19:34.706407 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:34.705447    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:34.812470 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:34.812431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" event={"ID":"c03930a7-f5f7-4964-b85d-fbef8614f6e5","Type":"ContainerStarted","Data":"46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0"}
Jul 18 02:19:35.019278 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:35.019233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:35.020312 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:35.020286    2562 patch_prober.go:28] interesting pod/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 18 02:19:35.020453 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:35.020380    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 18 02:19:36.019643 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:36.019604    2562 patch_prober.go:28] interesting pod/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 18 02:19:36.020150 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:36.019665    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 18 02:19:37.019137 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:37.019091    2562 patch_prober.go:28] interesting pod/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 18 02:19:37.019357 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:37.019154    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 18 02:19:38.019078 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:38.019039    2562 patch_prober.go:28] interesting pod/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 18 02:19:38.019518 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:38.019098    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 18 02:19:39.023019 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:39.022987    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:39.023550 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:39.023261    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:39.024136 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:39.024117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:42.809284 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:42.809239    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"]
Jul 18 02:19:42.809784 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:42.809552    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz" podUID="c4f84d69-b02c-4534-953e-9308ae58565f" containerName="maas-api" containerID="cri-o://23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc" gracePeriod=30
Jul 18 02:19:42.840337 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:42.840293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:43.062259 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.062194    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:43.199003 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.198952    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f84d69-b02c-4534-953e-9308ae58565f-maas-api-tls\") pod \"c4f84d69-b02c-4534-953e-9308ae58565f\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") "
Jul 18 02:19:43.199003 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.199011    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v42z\" (UniqueName: \"kubernetes.io/projected/c4f84d69-b02c-4534-953e-9308ae58565f-kube-api-access-6v42z\") pod \"c4f84d69-b02c-4534-953e-9308ae58565f\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") "
Jul 18 02:19:43.199237 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.199044    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f84d69-b02c-4534-953e-9308ae58565f-openshift-service-ca\") pod \"c4f84d69-b02c-4534-953e-9308ae58565f\" (UID: \"c4f84d69-b02c-4534-953e-9308ae58565f\") "
Jul 18 02:19:43.199456 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.199430    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4f84d69-b02c-4534-953e-9308ae58565f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4f84d69-b02c-4534-953e-9308ae58565f" (UID: "c4f84d69-b02c-4534-953e-9308ae58565f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:19:43.201265 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.201243    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f84d69-b02c-4534-953e-9308ae58565f-kube-api-access-6v42z" (OuterVolumeSpecName: "kube-api-access-6v42z") pod "c4f84d69-b02c-4534-953e-9308ae58565f" (UID: "c4f84d69-b02c-4534-953e-9308ae58565f"). InnerVolumeSpecName "kube-api-access-6v42z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:19:43.201370 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.201241    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f84d69-b02c-4534-953e-9308ae58565f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4f84d69-b02c-4534-953e-9308ae58565f" (UID: "c4f84d69-b02c-4534-953e-9308ae58565f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:19:43.300557 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.300518    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f84d69-b02c-4534-953e-9308ae58565f-maas-api-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:43.300557 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.300554    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v42z\" (UniqueName: \"kubernetes.io/projected/c4f84d69-b02c-4534-953e-9308ae58565f-kube-api-access-6v42z\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:43.300557 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.300570    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f84d69-b02c-4534-953e-9308ae58565f-openshift-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:43.859428 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.859390    2562 generic.go:356] "Generic (PLEG): container finished" podID="c4f84d69-b02c-4534-953e-9308ae58565f" containerID="23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc" exitCode=0
Jul 18 02:19:43.859428 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.859431    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"
Jul 18 02:19:43.859988 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.859473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz" event={"ID":"c4f84d69-b02c-4534-953e-9308ae58565f","Type":"ContainerDied","Data":"23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc"}
Jul 18 02:19:43.859988 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.859524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz" event={"ID":"c4f84d69-b02c-4534-953e-9308ae58565f","Type":"ContainerDied","Data":"5eab2a36f885c18a7d5dcda78afee3e1f2d5fbbca65a26b5dd0b66cc3d37e634"}
Jul 18 02:19:43.859988 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.859546    2562 scope.go:117] "RemoveContainer" containerID="23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc"
Jul 18 02:19:43.868634 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.868614    2562 scope.go:117] "RemoveContainer" containerID="23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc"
Jul 18 02:19:43.868898 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:19:43.868879    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc\": container with ID starting with 23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc not found: ID does not exist" containerID="23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc"
Jul 18 02:19:43.868967 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.868906    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc"} err="failed to get container status \"23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc\": rpc error: code = NotFound desc = could not find container \"23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc\": container with ID starting with 23389e08021dab47d2c6b01eb87602142705b3c7ba5a81eee9a14146cb021ffc not found: ID does not exist"
Jul 18 02:19:43.879493 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.879469    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"]
Jul 18 02:19:43.882420 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:43.882398    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-59ca50e9-55f45c9b69-lmvtz"]
Jul 18 02:19:44.532179 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:44.532140    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4f84d69-b02c-4534-953e-9308ae58565f" path="/var/lib/kubelet/pods/c4f84d69-b02c-4534-953e-9308ae58565f/volumes"
Jul 18 02:19:47.384553 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:47.384519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:47.834211 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:47.834180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:53.930508 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:53.930470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:54.031339 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.031288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:54.170506 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.170473    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"]
Jul 18 02:19:54.170735 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.170709    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy" containerID="cri-o://46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0" gracePeriod=30
Jul 18 02:19:54.193021 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.192937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:54.407471 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.407435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:54.527403 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.527364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:54.628582 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.628545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:54.739295 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:54.739257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:19:59.425246 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.425222    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:59.562217 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562176    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jpdc\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-kube-api-access-5jpdc\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562252    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-socket\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562289    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-podinfo\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562345    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-envoy\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562379    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-data\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562407    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-certs\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562433    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istiod-ca-cert\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562787 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562462    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-token\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562787 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562510    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-credential-socket\") pod \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\" (UID: \"c03930a7-f5f7-4964-b85d-fbef8614f6e5\") "
Jul 18 02:19:59.562787 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562516    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:59.562787 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562674    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:59.562996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562900    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.562996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562920    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.562996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562897    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:59.562996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.562920    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:19:59.563695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.563666    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:59.564632 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.564599    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:19:59.564632 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.564616    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:19:59.564760 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.564689    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-kube-api-access-5jpdc" (OuterVolumeSpecName: "kube-api-access-5jpdc") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "kube-api-access-5jpdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:19:59.564967 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.564946    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c03930a7-f5f7-4964-b85d-fbef8614f6e5" (UID: "c03930a7-f5f7-4964-b85d-fbef8614f6e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:19:59.664140 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.664092    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jpdc\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-kube-api-access-5jpdc\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.664140 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.664133    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.664140 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.664143    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.664140 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.664151    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.664474 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.664160    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.664474 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.664168    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03930a7-f5f7-4964-b85d-fbef8614f6e5-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.664474 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.664175    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03930a7-f5f7-4964-b85d-fbef8614f6e5-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:19:59.941994 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.941897    2562 generic.go:356] "Generic (PLEG): container finished" podID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerID="46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0" exitCode=0
Jul 18 02:19:59.941994 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.941949    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"
Jul 18 02:19:59.941994 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.941979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" event={"ID":"c03930a7-f5f7-4964-b85d-fbef8614f6e5","Type":"ContainerDied","Data":"46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0"}
Jul 18 02:19:59.942233 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.942037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw" event={"ID":"c03930a7-f5f7-4964-b85d-fbef8614f6e5","Type":"ContainerDied","Data":"535c4e3892c55559146603cc3a180a7f438288eff8062f488e94373a127b3571"}
Jul 18 02:19:59.942233 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.942069    2562 scope.go:117] "RemoveContainer" containerID="46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0"
Jul 18 02:19:59.951713 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.951692    2562 scope.go:117] "RemoveContainer" containerID="a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a"
Jul 18 02:19:59.960599 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.960572    2562 scope.go:117] "RemoveContainer" containerID="46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0"
Jul 18 02:19:59.961048 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:19:59.960988    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0\": container with ID starting with 46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0 not found: ID does not exist" containerID="46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0"
Jul 18 02:19:59.961048 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.961030    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0"} err="failed to get container status \"46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0\": rpc error: code = NotFound desc = could not find container \"46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0\": container with ID starting with 46c5ac9e71c97e8c56568e2906167ba27c98c16c44fdd8803fa3fd8b0fd33ef0 not found: ID does not exist"
Jul 18 02:19:59.961390 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.961055    2562 scope.go:117] "RemoveContainer" containerID="a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a"
Jul 18 02:19:59.961460 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:19:59.961414    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a\": container with ID starting with a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a not found: ID does not exist" containerID="a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a"
Jul 18 02:19:59.961527 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.961464    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a"} err="failed to get container status \"a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a\": rpc error: code = NotFound desc = could not find container \"a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a\": container with ID starting with a226a6639c800a0d53feb275d55ebf0aa492cc2597cc4a1b94a63ed407e6d33a not found: ID does not exist"
Jul 18 02:19:59.964223 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.964199    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"]
Jul 18 02:19:59.966063 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:19:59.966047    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-59ca50e9-openshift-default-bf7d7b767-nnmpw"]
Jul 18 02:20:00.448681 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:00.448646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:00.514377 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:00.514314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:00.531624 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:00.531597    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" path="/var/lib/kubelet/pods/c03930a7-f5f7-4964-b85d-fbef8614f6e5/volumes"
Jul 18 02:20:00.590817 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:00.590785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:00.692097 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:00.692067    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:00.803190 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:00.803157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:06.444278 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:06.444244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:06.544558 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:06.544519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:13.185100 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.185055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:13.466219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466140    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"]
Jul 18 02:20:13.466560 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466547    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy"
Jul 18 02:20:13.466613 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466561    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy"
Jul 18 02:20:13.466613 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466573    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy"
Jul 18 02:20:13.466613 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466578    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy"
Jul 18 02:20:13.466613 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466591    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f84d69-b02c-4534-953e-9308ae58565f" containerName="maas-api"
Jul 18 02:20:13.466613 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466597    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f84d69-b02c-4534-953e-9308ae58565f" containerName="maas-api"
Jul 18 02:20:13.466769 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466663    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy"
Jul 18 02:20:13.466769 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.466670    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f84d69-b02c-4534-953e-9308ae58565f" containerName="maas-api"
Jul 18 02:20:13.471529 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.471505    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.473968 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.473939    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 02:20:13.474090 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.473943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e9b53c5b-openshift-default-dockercfg-4nqq2\""
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-podinfo\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-token\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cbqs\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-kube-api-access-8cbqs\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-credential-socket\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-data\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-certs\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-socket\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c24268-5bc0-4d97-80c4-e3e866deee60-istiod-ca-cert\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.479808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.479701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-envoy\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.481152 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.481114    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"]
Jul 18 02:20:13.496699 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.496674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:13.580385 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-certs\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580385 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-socket\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580654 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c24268-5bc0-4d97-80c4-e3e866deee60-istiod-ca-cert\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580654 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-envoy\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580654 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-podinfo\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580654 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-token\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580654 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cbqs\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-kube-api-access-8cbqs\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580920 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-credential-socket\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580920 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-data\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580920 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-certs\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.580920 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.580836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-socket\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.581118 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.581012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-data\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.581118 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.581068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-credential-socket\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.581219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.581195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c24268-5bc0-4d97-80c4-e3e866deee60-istiod-ca-cert\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.582931 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.582905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-envoy\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.583116 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.583098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-podinfo\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.588236 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.588209    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-token\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.588645 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.588624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cbqs\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-kube-api-access-8cbqs\") pod \"e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") " pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.783872 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.783830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:13.809851 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.809817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:13.942087 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.942060    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"]
Jul 18 02:20:13.944021 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:20:13.943991    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c24268_5bc0_4d97_80c4_e3e866deee60.slice/crio-e2a954fd047880c69a52603cff7d936a01a906ee321545fcca5d32901cdfbff4 WatchSource:0}: Error finding container e2a954fd047880c69a52603cff7d936a01a906ee321545fcca5d32901cdfbff4: Status 404 returned error can't find the container with id e2a954fd047880c69a52603cff7d936a01a906ee321545fcca5d32901cdfbff4
Jul 18 02:20:13.946305 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.946271    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:20:13.946424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.946358    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:20:13.946424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:13.946393    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:20:14.021391 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:14.021357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" event={"ID":"02c24268-5bc0-4d97-80c4-e3e866deee60","Type":"ContainerStarted","Data":"9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b"}
Jul 18 02:20:14.021563 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:14.021422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" event={"ID":"02c24268-5bc0-4d97-80c4-e3e866deee60","Type":"ContainerStarted","Data":"e2a954fd047880c69a52603cff7d936a01a906ee321545fcca5d32901cdfbff4"}
Jul 18 02:20:14.074609 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:14.074478    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" podStartSLOduration=1.074452188 podStartE2EDuration="1.074452188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:20:14.070748444 +0000 UTC m=+1921.470148102" watchObservedRunningTime="2026-07-18 02:20:14.074452188 +0000 UTC m=+1921.473851848"
Jul 18 02:20:14.784425 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:14.784391    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:15.789559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:15.789530    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:15.957959 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:15.957918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:16.031647 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:16.031612    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:16.032789 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:16.032762    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:16.046710 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:16.046619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:16.118964 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:16.118933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:16.237747 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:16.237711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:16.728248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:16.728219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:16.828847 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:16.828815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:20.490419 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:20.490377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:29.100734 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.100697    2562 generic.go:356] "Generic (PLEG): container finished" podID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerID="9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b" exitCode=0
Jul 18 02:20:29.101147 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.100750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" event={"ID":"02c24268-5bc0-4d97-80c4-e3e866deee60","Type":"ContainerDied","Data":"9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b"}
Jul 18 02:20:29.101207 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.101174    2562 scope.go:117] "RemoveContainer" containerID="9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b"
Jul 18 02:20:29.102289 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.102260    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:20:29.102396 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.102376    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:20:29.102441 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.102419    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:20:29.484237 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.484149    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"]
Jul 18 02:20:29.484682 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.484666    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03930a7-f5f7-4964-b85d-fbef8614f6e5" containerName="istio-proxy"
Jul 18 02:20:29.487673 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.487657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.490360 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.490333    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e9b53c5b\"/\"e2e-lifecycle-model-e9b53c5b-kserve-self-signed-certs\""
Jul 18 02:20:29.490360 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.490351    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e9b53c5b\"/\"default-dockercfg-2rcck\""
Jul 18 02:20:29.490574 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.490318    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e9b53c5b\"/\"openshift-service-ca.crt\""
Jul 18 02:20:29.490574 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.490488    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e9b53c5b\"/\"kube-root-ca.crt\""
Jul 18 02:20:29.496943 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.496917    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"]
Jul 18 02:20:29.516297 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.516262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:20:29.644248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.644211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-tmp-dir\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.644445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.644290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff32901-e76f-42a2-9180-9f50ed20650e-tls-certs\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.644445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.644422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-model-cache\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.644540 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.644472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-home\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.644586 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.644547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-dshm\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.644625 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.644598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smsq6\" (UniqueName: \"kubernetes.io/projected/aff32901-e76f-42a2-9180-9f50ed20650e-kube-api-access-smsq6\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.745838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.745737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-home\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.745838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.745791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-dshm\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.745838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.745828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smsq6\" (UniqueName: \"kubernetes.io/projected/aff32901-e76f-42a2-9180-9f50ed20650e-kube-api-access-smsq6\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.746075 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.745855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-tmp-dir\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.746075 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.745924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff32901-e76f-42a2-9180-9f50ed20650e-tls-certs\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.746075 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.746022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-model-cache\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.746269 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.746241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-home\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.746416 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.746398    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-model-cache\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.746494 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.746464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-tmp-dir\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.748219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.748196    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-dshm\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.748489 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.748471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff32901-e76f-42a2-9180-9f50ed20650e-tls-certs\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.754255 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.754221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smsq6\" (UniqueName: \"kubernetes.io/projected/aff32901-e76f-42a2-9180-9f50ed20650e-kube-api-access-smsq6\") pod \"e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") " pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.799663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.799621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:29.936265 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:29.935818    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"]
Jul 18 02:20:30.113519 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:30.113485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" event={"ID":"02c24268-5bc0-4d97-80c4-e3e866deee60","Type":"ContainerStarted","Data":"5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3"}
Jul 18 02:20:30.115139 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:30.115116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z" event={"ID":"aff32901-e76f-42a2-9180-9f50ed20650e","Type":"ContainerStarted","Data":"99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819"}
Jul 18 02:20:30.115139 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:30.115148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z" event={"ID":"aff32901-e76f-42a2-9180-9f50ed20650e","Type":"ContainerStarted","Data":"391babf4e28fe463e35906d72273e404f63edcf14bd1adafa2025de67a89cfb2"}
Jul 18 02:20:30.148173 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:30.148117    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z" podStartSLOduration=1.148099444 podStartE2EDuration="1.148099444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:20:30.147235343 +0000 UTC m=+1937.546634996" watchObservedRunningTime="2026-07-18 02:20:30.148099444 +0000 UTC m=+1937.547499103"
Jul 18 02:20:30.784549 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:30.784502    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:30.785972 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:30.785935    2562 patch_prober.go:28] interesting pod/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 18 02:20:30.786131 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:30.786006    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 18 02:20:31.031850 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:31.031809    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:31.785391 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:31.785348    2562 patch_prober.go:28] interesting pod/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 18 02:20:31.786046 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:31.786007    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 18 02:20:32.785527 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:32.785040    2562 patch_prober.go:28] interesting pod/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 18 02:20:32.785527 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:32.785126    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 18 02:20:33.785268 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:33.784792    2562 patch_prober.go:28] interesting pod/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 18 02:20:33.785268 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:33.784863    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 18 02:20:34.788946 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:34.788920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:34.789903 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:34.789884    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:20:39.800555 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:39.800514    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:39.800555 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:39.800565    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:39.813283 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:39.813251    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:20:40.178737 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:20:40.178641    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:21:04.099554 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:04.099519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:08.739063 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:08.739020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:10.940256 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:10.940188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:13.236333 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:13.236282    2562 scope.go:117] "RemoveContainer" containerID="41969c82ccd68825e05f297e11ea92266925e5a322264658ffc54087f4771905"
Jul 18 02:21:13.244776 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:13.244755    2562 scope.go:117] "RemoveContainer" containerID="c63ea4c0a0451132cf6b083db89aaa01e1ebd5f17456b77b5caef1678a7f750f"
Jul 18 02:21:15.922316 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:15.922274    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"]
Jul 18 02:21:15.964761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:15.964717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:29.241920 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:29.241879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:30.943652 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:30.943607    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z" podUID="aff32901-e76f-42a2-9180-9f50ed20650e" containerName="main" containerID="cri-o://99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819" gracePeriod=45
Jul 18 02:21:31.198682 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.198619    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:21:31.267473 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.267442    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smsq6\" (UniqueName: \"kubernetes.io/projected/aff32901-e76f-42a2-9180-9f50ed20650e-kube-api-access-smsq6\") pod \"aff32901-e76f-42a2-9180-9f50ed20650e\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") "
Jul 18 02:21:31.267646 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.267590    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-home\") pod \"aff32901-e76f-42a2-9180-9f50ed20650e\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") "
Jul 18 02:21:31.267695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.267651    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff32901-e76f-42a2-9180-9f50ed20650e-tls-certs\") pod \"aff32901-e76f-42a2-9180-9f50ed20650e\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") "
Jul 18 02:21:31.267695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.267688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-model-cache\") pod \"aff32901-e76f-42a2-9180-9f50ed20650e\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") "
Jul 18 02:21:31.267772 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.267753    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-dshm\") pod \"aff32901-e76f-42a2-9180-9f50ed20650e\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") "
Jul 18 02:21:31.267819 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.267789    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-tmp-dir\") pod \"aff32901-e76f-42a2-9180-9f50ed20650e\" (UID: \"aff32901-e76f-42a2-9180-9f50ed20650e\") "
Jul 18 02:21:31.267874 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.267818    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-home" (OuterVolumeSpecName: "home") pod "aff32901-e76f-42a2-9180-9f50ed20650e" (UID: "aff32901-e76f-42a2-9180-9f50ed20650e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:31.268079 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.268043    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-model-cache" (OuterVolumeSpecName: "model-cache") pod "aff32901-e76f-42a2-9180-9f50ed20650e" (UID: "aff32901-e76f-42a2-9180-9f50ed20650e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:31.268079 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.268053    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aff32901-e76f-42a2-9180-9f50ed20650e" (UID: "aff32901-e76f-42a2-9180-9f50ed20650e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:31.268267 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.268179    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-tmp-dir\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:21:31.268267 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.268196    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-home\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:21:31.268267 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.268209    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-model-cache\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:21:31.269978 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.269931    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff32901-e76f-42a2-9180-9f50ed20650e-kube-api-access-smsq6" (OuterVolumeSpecName: "kube-api-access-smsq6") pod "aff32901-e76f-42a2-9180-9f50ed20650e" (UID: "aff32901-e76f-42a2-9180-9f50ed20650e"). InnerVolumeSpecName "kube-api-access-smsq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:21:31.270172 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.270149    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff32901-e76f-42a2-9180-9f50ed20650e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aff32901-e76f-42a2-9180-9f50ed20650e" (UID: "aff32901-e76f-42a2-9180-9f50ed20650e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:21:31.270225 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.270155    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-dshm" (OuterVolumeSpecName: "dshm") pod "aff32901-e76f-42a2-9180-9f50ed20650e" (UID: "aff32901-e76f-42a2-9180-9f50ed20650e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:21:31.368705 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.368667    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aff32901-e76f-42a2-9180-9f50ed20650e-dshm\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:21:31.368705 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.368700    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smsq6\" (UniqueName: \"kubernetes.io/projected/aff32901-e76f-42a2-9180-9f50ed20650e-kube-api-access-smsq6\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:21:31.368705 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.368710    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff32901-e76f-42a2-9180-9f50ed20650e-tls-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:21:31.433577 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.433537    2562 generic.go:356] "Generic (PLEG): container finished" podID="aff32901-e76f-42a2-9180-9f50ed20650e" containerID="99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819" exitCode=0
Jul 18 02:21:31.433755 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.433586    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"
Jul 18 02:21:31.433755 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.433620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z" event={"ID":"aff32901-e76f-42a2-9180-9f50ed20650e","Type":"ContainerDied","Data":"99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819"}
Jul 18 02:21:31.433755 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.433666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z" event={"ID":"aff32901-e76f-42a2-9180-9f50ed20650e","Type":"ContainerDied","Data":"391babf4e28fe463e35906d72273e404f63edcf14bd1adafa2025de67a89cfb2"}
Jul 18 02:21:31.433755 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.433683    2562 scope.go:117] "RemoveContainer" containerID="99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819"
Jul 18 02:21:31.443135 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.443116    2562 scope.go:117] "RemoveContainer" containerID="99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819"
Jul 18 02:21:31.443414 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:21:31.443395    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819\": container with ID starting with 99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819 not found: ID does not exist" containerID="99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819"
Jul 18 02:21:31.443477 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.443426    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819"} err="failed to get container status \"99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819\": rpc error: code = NotFound desc = could not find container \"99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819\": container with ID starting with 99b7c0c514510eb068f70be37f4f96600f7e25283e9b45fd1726881d3937a819 not found: ID does not exist"
Jul 18 02:21:31.456290 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.456211    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"]
Jul 18 02:21:31.462856 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:31.462827    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e9b53c5b/e2e-lifecycle-model-e9b53c5b-kserve-fdd94d49f-n2h8z"]
Jul 18 02:21:32.531246 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:32.531213    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff32901-e76f-42a2-9180-9f50ed20650e" path="/var/lib/kubelet/pods/aff32901-e76f-42a2-9180-9f50ed20650e/volumes"
Jul 18 02:21:52.059445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:52.059393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:53.082902 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:53.082862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:58.544734 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:58.544697    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:58.644695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:58.644659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:58.799755 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:58.799651    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"]
Jul 18 02:21:58.799965 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:58.799937    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy" containerID="cri-o://5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3" gracePeriod=30
Jul 18 02:21:58.824894 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:58.824857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:21:59.056700 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:21:59.056613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:00.099412 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:00.099371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:00.197470 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:00.197435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:00.295388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:00.295356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:01.111084 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:01.111045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:01.197521 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:01.197487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:02.631713 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:02.631679    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:04.057980 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.057952    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:22:04.083915 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.083828    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-socket\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.083915 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.083881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-token\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084150 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.083927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-podinfo\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084150 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.083984    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-data\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084150 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-envoy\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084315 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084159    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c24268-5bc0-4d97-80c4-e3e866deee60-istiod-ca-cert\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084315 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:22:04.084315 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084188    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cbqs\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-kube-api-access-8cbqs\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084315 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-credential-socket\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084315 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084291    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-certs\") pod \"02c24268-5bc0-4d97-80c4-e3e866deee60\" (UID: \"02c24268-5bc0-4d97-80c4-e3e866deee60\") "
Jul 18 02:22:04.084630 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084601    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:22:04.084739 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084720    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.084967 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084952    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.085078 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.084885    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-data" (OuterVolumeSpecName: "istio-data") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:22:04.085199 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.085060    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c24268-5bc0-4d97-80c4-e3e866deee60-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:22:04.085199 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.085113    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:22:04.086438 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.086409    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-token" (OuterVolumeSpecName: "istio-token") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:22:04.086542 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.086409    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-kube-api-access-8cbqs" (OuterVolumeSpecName: "kube-api-access-8cbqs") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "kube-api-access-8cbqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:22:04.086542 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.086476    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:22:04.086711 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.086693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02c24268-5bc0-4d97-80c4-e3e866deee60" (UID: "02c24268-5bc0-4d97-80c4-e3e866deee60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:22:04.186427 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.186387    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.186427 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.186418    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.186427 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.186427    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02c24268-5bc0-4d97-80c4-e3e866deee60-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.186427 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.186438    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cbqs\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-kube-api-access-8cbqs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.186703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.186449    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c24268-5bc0-4d97-80c4-e3e866deee60-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.186703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.186458    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.186703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.186466    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02c24268-5bc0-4d97-80c4-e3e866deee60-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:22:04.598339 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.598294    2562 generic.go:356] "Generic (PLEG): container finished" podID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerID="5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3" exitCode=0
Jul 18 02:22:04.598511 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.598356    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"
Jul 18 02:22:04.598511 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.598356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" event={"ID":"02c24268-5bc0-4d97-80c4-e3e866deee60","Type":"ContainerDied","Data":"5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3"}
Jul 18 02:22:04.598511 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.598415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8" event={"ID":"02c24268-5bc0-4d97-80c4-e3e866deee60","Type":"ContainerDied","Data":"e2a954fd047880c69a52603cff7d936a01a906ee321545fcca5d32901cdfbff4"}
Jul 18 02:22:04.598511 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.598435    2562 scope.go:117] "RemoveContainer" containerID="5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3"
Jul 18 02:22:04.607455 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.607432    2562 scope.go:117] "RemoveContainer" containerID="9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b"
Jul 18 02:22:04.617037 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.617018    2562 scope.go:117] "RemoveContainer" containerID="5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3"
Jul 18 02:22:04.617341 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.617304    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"]
Jul 18 02:22:04.617408 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:22:04.617338    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3\": container with ID starting with 5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3 not found: ID does not exist" containerID="5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3"
Jul 18 02:22:04.617408 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.617364    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3"} err="failed to get container status \"5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3\": rpc error: code = NotFound desc = could not find container \"5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3\": container with ID starting with 5ca3d2aa97d35b97ba67e52c13d44483e225db9019c2016955d478ed0b0ae5b3 not found: ID does not exist"
Jul 18 02:22:04.617408 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.617386    2562 scope.go:117] "RemoveContainer" containerID="9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b"
Jul 18 02:22:04.617653 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:22:04.617636    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b\": container with ID starting with 9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b not found: ID does not exist" containerID="9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b"
Jul 18 02:22:04.617708 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.617664    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b"} err="failed to get container status \"9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b\": rpc error: code = NotFound desc = could not find container \"9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b\": container with ID starting with 9bb59a3fa9eebe2746fe31457e2b7775987f2f9a0139b81bbf40e38720af834b not found: ID does not exist"
Jul 18 02:22:04.624079 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:04.624053    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e9b53c5b-openshift-default-6b6d758d95-j54w8"]
Jul 18 02:22:06.531792 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:06.531760    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" path="/var/lib/kubelet/pods/02c24268-5bc0-4d97-80c4-e3e866deee60/volumes"
Jul 18 02:22:08.396640 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:08.396609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:08.496859 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:08.496823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:09.056883 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:09.056833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:13.267687 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:13.267657    2562 scope.go:117] "RemoveContainer" containerID="61270632a5740fb2dd6fe21e8a9e2fd94ff61afd458dad6b4291a4ba0468ed12"
Jul 18 02:22:15.315720 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:15.315675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:15.463619 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:15.463580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:15.541870 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:15.541820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:26.023912 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:26.023874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:26.394492 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:26.394394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:42.855189 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:42.855095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:42.952818 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:42.952781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:47.375115 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:47.375082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:54.488630 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:54.488573    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:54.589313 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:54.589274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:54.832314 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:54.832279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:55.112514 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112431    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"]
Jul 18 02:22:55.112823 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112811    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff32901-e76f-42a2-9180-9f50ed20650e" containerName="main"
Jul 18 02:22:55.112869 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112824    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff32901-e76f-42a2-9180-9f50ed20650e" containerName="main"
Jul 18 02:22:55.112869 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112835    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy"
Jul 18 02:22:55.112869 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112841    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy"
Jul 18 02:22:55.112869 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112861    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy"
Jul 18 02:22:55.112869 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112867    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy"
Jul 18 02:22:55.113019 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112924    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy"
Jul 18 02:22:55.113019 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.112934    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff32901-e76f-42a2-9180-9f50ed20650e" containerName="main"
Jul 18 02:22:55.115896 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.115876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.118577 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.118548    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 02:22:55.118703 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.118670    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-289d75-openshift-default-dockercfg-7z6gt\""
Jul 18 02:22:55.131065 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.131036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"]
Jul 18 02:22:55.137394 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.137367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:55.163978 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.163937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-credential-socket\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.163978 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.163987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e631912a-4805-4363-8cd5-ef83b73bc3af-istiod-ca-cert\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.164209 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.164022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-socket\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.164209 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.164049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-podinfo\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.164209 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.164067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-certs\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.164209 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.164139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gt7w\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-kube-api-access-5gt7w\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.164209 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.164202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-data\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.164453 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.164248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-token\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.164453 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.164280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-envoy\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.264978 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.264937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-envoy\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.264978 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.264981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-credential-socket\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265193 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e631912a-4805-4363-8cd5-ef83b73bc3af-istiod-ca-cert\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265193 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265153    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-socket\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265289 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-podinfo\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265289 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-certs\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265289 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gt7w\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-kube-api-access-5gt7w\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265497 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-data\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265497 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-token\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265497 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-credential-socket\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265661 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-socket\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265817    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e631912a-4805-4363-8cd5-ef83b73bc3af-istiod-ca-cert\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265901 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265849    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-data\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.265998 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.265974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-certs\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.267391 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.267369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-envoy\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.267811 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.267789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-podinfo\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.274030 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.274003    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-token\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.274167 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.274089    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gt7w\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-kube-api-access-5gt7w\") pod \"e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") " pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.319190 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.319146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:55.426567 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.426477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:55.570235 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.570203    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"]
Jul 18 02:22:55.572786 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:22:55.572747    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode631912a_4805_4363_8cd5_ef83b73bc3af.slice/crio-9d79ff7191a52bf73d56f3280b47a35830e30ca6e9056f18cf293c6da0d458d9 WatchSource:0}: Error finding container 9d79ff7191a52bf73d56f3280b47a35830e30ca6e9056f18cf293c6da0d458d9: Status 404 returned error can't find the container with id 9d79ff7191a52bf73d56f3280b47a35830e30ca6e9056f18cf293c6da0d458d9
Jul 18 02:22:55.575248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.575201    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:22:55.575360 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.575309    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:22:55.575419 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.575390    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:22:55.858954 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.858915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" event={"ID":"e631912a-4805-4363-8cd5-ef83b73bc3af","Type":"ContainerStarted","Data":"108019dce24f7cb6e35f45a5f3a014c5b5f5aa3c50d86619f0e7b036c3598cca"}
Jul 18 02:22:55.859184 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.858986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" event={"ID":"e631912a-4805-4363-8cd5-ef83b73bc3af","Type":"ContainerStarted","Data":"9d79ff7191a52bf73d56f3280b47a35830e30ca6e9056f18cf293c6da0d458d9"}
Jul 18 02:22:55.893875 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:55.893818    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podStartSLOduration=0.893799884 podStartE2EDuration="893.799884ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:22:55.891098226 +0000 UTC m=+2083.290497886" watchObservedRunningTime="2026-07-18 02:22:55.893799884 +0000 UTC m=+2083.293199625"
Jul 18 02:22:56.427623 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:56.427562    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:56.433700 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:56.433669    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:56.864046 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:56.864008    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:56.865137 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:56.865118    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:22:57.827089 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:57.827054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:57.923337 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:57.923293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:58.088890 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:58.088777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:58.472582 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:58.472483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:58.628039 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:58.628004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:22:58.730297 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:22:58.730183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:02.304910 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.304861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:02.643888 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.643789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:02.907951 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.907866    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"]
Jul 18 02:23:02.908570 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.908554    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c24268-5bc0-4d97-80c4-e3e866deee60" containerName="istio-proxy"
Jul 18 02:23:02.912229 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.912207    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:02.914661 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.914639    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5eb23f-openshift-default-dockercfg-2hr6j\""
Jul 18 02:23:02.924159 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.924133    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"]
Jul 18 02:23:02.939859 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:02.939828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:03.037235 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-certs\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037235 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-data\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037480 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-socket\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037480 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5sb\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-kube-api-access-8m5sb\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037480 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-podinfo\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037480 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-envoy\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037480 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-token\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037480 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istiod-ca-cert\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.037673 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.037525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-credential-socket\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138125 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-certs\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138308 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-data\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138308 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-socket\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138308 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5sb\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-kube-api-access-8m5sb\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138308 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-podinfo\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138308 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-envoy\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138308 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-token\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138308 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istiod-ca-cert\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138711 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-credential-socket\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138711 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138594    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-certs\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138827 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-socket\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138869 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-data\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.138915 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.138875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-credential-socket\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.139106 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.139087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istiod-ca-cert\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.141185 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.141160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-envoy\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.141376 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.141361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-podinfo\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.146498 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.146469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-token\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.146610 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.146470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5sb\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-kube-api-access-8m5sb\") pod \"e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") " pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.224745 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.224651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:03.368003 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.367961    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"]
Jul 18 02:23:03.374920 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:23:03.374890    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb927f2d_9b02_44ae_ab17_45bcfd68f6b5.slice/crio-d635700f475e9adbb52c35dc50307599f7c109d46d8597d9e4517933c6359270 WatchSource:0}: Error finding container d635700f475e9adbb52c35dc50307599f7c109d46d8597d9e4517933c6359270: Status 404 returned error can't find the container with id d635700f475e9adbb52c35dc50307599f7c109d46d8597d9e4517933c6359270
Jul 18 02:23:03.377057 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.377014    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:03.377137 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.377112    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:03.377180 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.377159    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:03.425891 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.425860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:03.901332 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.901272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" event={"ID":"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5","Type":"ContainerStarted","Data":"dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5"}
Jul 18 02:23:03.901544 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.901346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" event={"ID":"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5","Type":"ContainerStarted","Data":"d635700f475e9adbb52c35dc50307599f7c109d46d8597d9e4517933c6359270"}
Jul 18 02:23:03.927493 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:03.927435    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podStartSLOduration=1.927417465 podStartE2EDuration="1.927417465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:23:03.925028597 +0000 UTC m=+2091.324428276" watchObservedRunningTime="2026-07-18 02:23:03.927417465 +0000 UTC m=+2091.326817124"
Jul 18 02:23:04.225708 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:04.225609    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:04.227283 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:04.227246    2562 patch_prober.go:28] interesting pod/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 18 02:23:04.227442 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:04.227303    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 18 02:23:05.230252 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.230221    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:05.813723 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.813686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:05.896078 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.896042    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"]
Jul 18 02:23:05.899812 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.899785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:05.902589 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.902554    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sfxcd\""
Jul 18 02:23:05.902825 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.902807    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5eb23f-serving-cert\""
Jul 18 02:23:05.911643 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.911618    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"]
Jul 18 02:23:05.913642 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.913620    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:05.914697 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.914676    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:05.915976 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.915949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:05.969617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.968451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:05.969617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.968496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6df6a7b-e2f7-4647-b77e-174f3f462982-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:05.969617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:05.968536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvtn5\" (UniqueName: \"kubernetes.io/projected/e6df6a7b-e2f7-4647-b77e-174f3f462982-kube-api-access-hvtn5\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.013119 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.013087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:06.069503 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.069395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.069503 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.069445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6df6a7b-e2f7-4647-b77e-174f3f462982-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.069503 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.069494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvtn5\" (UniqueName: \"kubernetes.io/projected/e6df6a7b-e2f7-4647-b77e-174f3f462982-kube-api-access-hvtn5\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.069801 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:23:06.069561    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-serving-cert: secret "maas-api-e2e-inf-b-5eb23f-serving-cert" not found
Jul 18 02:23:06.069801 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:23:06.069638    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls podName:e6df6a7b-e2f7-4647-b77e-174f3f462982 nodeName:}" failed. No retries permitted until 2026-07-18 02:23:06.569615894 +0000 UTC m=+2093.969015543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls") pod "maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl" (UID: "e6df6a7b-e2f7-4647-b77e-174f3f462982") : secret "maas-api-e2e-inf-b-5eb23f-serving-cert" not found
Jul 18 02:23:06.070277 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.070256    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6df6a7b-e2f7-4647-b77e-174f3f462982-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.092273 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.092227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvtn5\" (UniqueName: \"kubernetes.io/projected/e6df6a7b-e2f7-4647-b77e-174f3f462982-kube-api-access-hvtn5\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.468164 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.468064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:06.569221 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.569184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:06.573912 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.573879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.576429 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.576407    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls\") pod \"maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.812181 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.812152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:06.976832 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.976806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"]
Jul 18 02:23:06.978950 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:23:06.978919    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6df6a7b_e2f7_4647_b77e_174f3f462982.slice/crio-108e076ae9968c7517144a5b8b3ff01afc6af93f68b32b696fc62c5fe0d912c7 WatchSource:0}: Error finding container 108e076ae9968c7517144a5b8b3ff01afc6af93f68b32b696fc62c5fe0d912c7: Status 404 returned error can't find the container with id 108e076ae9968c7517144a5b8b3ff01afc6af93f68b32b696fc62c5fe0d912c7
Jul 18 02:23:06.980469 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:06.980450    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:23:07.925998 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:07.925959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl" event={"ID":"e6df6a7b-e2f7-4647-b77e-174f3f462982","Type":"ContainerStarted","Data":"aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762"}
Jul 18 02:23:07.926503 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:07.926017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl" event={"ID":"e6df6a7b-e2f7-4647-b77e-174f3f462982","Type":"ContainerStarted","Data":"108e076ae9968c7517144a5b8b3ff01afc6af93f68b32b696fc62c5fe0d912c7"}
Jul 18 02:23:07.926503 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:07.926214    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:07.943296 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:07.943244    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl" podStartSLOduration=2.602798258 podStartE2EDuration="2.943227544s" totalImagesPullingTime="340.429286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:23:07.942820129 +0000 UTC m=+2095.342219789" watchObservedRunningTime="2026-07-18 02:23:07.943227544 +0000 UTC m=+2095.342627203"
Jul 18 02:23:10.292979 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:10.292943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:12.905580 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:12.905529    2562 patch_prober.go:28] interesting pod/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 18 02:23:12.906119 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:12.905621    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 18 02:23:13.297716 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.297678    2562 scope.go:117] "RemoveContainer" containerID="fd9ead055c59b3746119cfe1548389d5b21de6dfbe700d3375e0de7aff4a7350"
Jul 18 02:23:13.937553 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.937520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:23:13.960030 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.959996    2562 generic.go:356] "Generic (PLEG): container finished" podID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerID="108019dce24f7cb6e35f45a5f3a014c5b5f5aa3c50d86619f0e7b036c3598cca" exitCode=0
Jul 18 02:23:13.960226 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.960059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" event={"ID":"e631912a-4805-4363-8cd5-ef83b73bc3af","Type":"ContainerDied","Data":"108019dce24f7cb6e35f45a5f3a014c5b5f5aa3c50d86619f0e7b036c3598cca"}
Jul 18 02:23:13.960519 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.960500    2562 scope.go:117] "RemoveContainer" containerID="108019dce24f7cb6e35f45a5f3a014c5b5f5aa3c50d86619f0e7b036c3598cca"
Jul 18 02:23:13.961629 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.961595    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:13.961729 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.961684    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:13.961729 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:13.961722    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:14.966741 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:14.966704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" event={"ID":"e631912a-4805-4363-8cd5-ef83b73bc3af","Type":"ContainerStarted","Data":"ddf36a0e023d5c6607c65a049c3f96d280772ac7abca09a7c87d4256a3c1a31f"}
Jul 18 02:23:15.427805 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:15.427767    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:23:15.428219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:15.428129    2562 patch_prober.go:28] interesting pod/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 18 02:23:15.428458 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:15.428434    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 18 02:23:16.428392 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:16.427830    2562 patch_prober.go:28] interesting pod/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 18 02:23:16.428392 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:16.427919    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 18 02:23:17.427387 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:17.427339    2562 patch_prober.go:28] interesting pod/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 18 02:23:17.427565 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:17.427442    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 18 02:23:18.427384 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:18.427344    2562 patch_prober.go:28] interesting pod/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 18 02:23:18.427777 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:18.427414    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 18 02:23:19.430513 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:19.430474    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:23:19.430957 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:19.430789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:23:19.431658 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:19.431643    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:23:20.423539 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:20.423443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:20.524175 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:20.524139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:20.915660 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:20.915623    2562 patch_prober.go:28] interesting pod/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 18 02:23:20.915823 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:20.915680    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 18 02:23:21.005984 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:21.005949    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerID="dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5" exitCode=0
Jul 18 02:23:21.006160 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:21.006021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" event={"ID":"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5","Type":"ContainerDied","Data":"dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5"}
Jul 18 02:23:21.006550 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:21.006528    2562 scope.go:117] "RemoveContainer" containerID="dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5"
Jul 18 02:23:21.007758 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:21.007732    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:21.007841 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:21.007831    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:21.007897 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:21.007867    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:23:22.016721 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:22.016686    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" event={"ID":"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5","Type":"ContainerStarted","Data":"d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4"}
Jul 18 02:23:22.225781 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:22.225738    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:22.226015 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:22.225989    2562 patch_prober.go:28] interesting pod/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 18 02:23:22.226096 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:22.226051    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 18 02:23:23.225294 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:23.225245    2562 patch_prober.go:28] interesting pod/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 18 02:23:23.225713 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:23.225317    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 18 02:23:24.225955 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:24.225913    2562 patch_prober.go:28] interesting pod/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 18 02:23:24.226396 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:24.225972    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 18 02:23:25.225463 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:25.225412    2562 patch_prober.go:28] interesting pod/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 18 02:23:25.225691 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:25.225489    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 18 02:23:26.230166 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:26.230137    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:26.230583 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:26.230412    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:26.231076 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:26.231061    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:23:27.207213 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:27.207175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:27.309681 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:27.309646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:29.254193 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:29.254152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:34.914856 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:34.914818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:23:51.485468 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:23:51.485437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:04.446699 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:04.446660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:04.510022 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:04.509980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:08.712911 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:08.712875    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:09.745291 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:09.745262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:10.493427 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:10.493384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:10.589093 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:10.589062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:20.302266 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:20.302229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:24.326598 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:24.326550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:24.918307 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:24.918269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:25.294983 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:25.294953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:30.929539 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:30.929501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:30.990688 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:30.990652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:31.168193 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:31.168151    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"]
Jul 18 02:24:31.168439 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:31.168403    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy" containerID="cri-o://ddf36a0e023d5c6607c65a049c3f96d280772ac7abca09a7c87d4256a3c1a31f" gracePeriod=30
Jul 18 02:24:31.194687 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:31.194604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:31.418483 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:31.418450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:32.256178 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:32.256144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:32.393903 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:32.393864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:34.432828 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:34.432788    2562 patch_prober.go:28] interesting pod/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:24:34.433294 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:34.432856    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:24:36.400564 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.400529    2562 generic.go:356] "Generic (PLEG): container finished" podID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerID="ddf36a0e023d5c6607c65a049c3f96d280772ac7abca09a7c87d4256a3c1a31f" exitCode=0
Jul 18 02:24:36.401054 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.400579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" event={"ID":"e631912a-4805-4363-8cd5-ef83b73bc3af","Type":"ContainerDied","Data":"ddf36a0e023d5c6607c65a049c3f96d280772ac7abca09a7c87d4256a3c1a31f"}
Jul 18 02:24:36.401054 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.400658    2562 scope.go:117] "RemoveContainer" containerID="108019dce24f7cb6e35f45a5f3a014c5b5f5aa3c50d86619f0e7b036c3598cca"
Jul 18 02:24:36.430660 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.430607    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:24:36.510941 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.510906    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gt7w\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-kube-api-access-5gt7w\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.510941 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.510953    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e631912a-4805-4363-8cd5-ef83b73bc3af-istiod-ca-cert\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.510992    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-envoy\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511019    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-certs\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511045    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-token\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511077    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-podinfo\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-socket\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-credential-socket\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511208    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-data\") pod \"e631912a-4805-4363-8cd5-ef83b73bc3af\" (UID: \"e631912a-4805-4363-8cd5-ef83b73bc3af\") "
Jul 18 02:24:36.511598 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511434    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:36.511598 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511444    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e631912a-4805-4363-8cd5-ef83b73bc3af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:24:36.511706 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511595    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:36.511706 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511621    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.511706 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511643    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e631912a-4805-4363-8cd5-ef83b73bc3af-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.511934 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.511723    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:36.512217 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.512196    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-data" (OuterVolumeSpecName: "istio-data") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:36.513434 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.513403    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-kube-api-access-5gt7w" (OuterVolumeSpecName: "kube-api-access-5gt7w") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "kube-api-access-5gt7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:36.513560 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.513510    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:36.513722 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.513698    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:24:36.513782 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.513698    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-token" (OuterVolumeSpecName: "istio-token") pod "e631912a-4805-4363-8cd5-ef83b73bc3af" (UID: "e631912a-4805-4363-8cd5-ef83b73bc3af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:36.613314 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.613264    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.613537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.613385    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.613537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.613411    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.613537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.613427    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.613537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.613441    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.613537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.613450    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gt7w\" (UniqueName: \"kubernetes.io/projected/e631912a-4805-4363-8cd5-ef83b73bc3af-kube-api-access-5gt7w\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:36.613537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:36.613460    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e631912a-4805-4363-8cd5-ef83b73bc3af-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:37.406462 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:37.406433    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"
Jul 18 02:24:37.406883 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:37.406470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2" event={"ID":"e631912a-4805-4363-8cd5-ef83b73bc3af","Type":"ContainerDied","Data":"9d79ff7191a52bf73d56f3280b47a35830e30ca6e9056f18cf293c6da0d458d9"}
Jul 18 02:24:37.406883 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:37.406527    2562 scope.go:117] "RemoveContainer" containerID="ddf36a0e023d5c6607c65a049c3f96d280772ac7abca09a7c87d4256a3c1a31f"
Jul 18 02:24:37.441769 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:37.441734    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"]
Jul 18 02:24:37.445231 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:37.445204    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-289d75-openshift-default-5bbcdf5ff5-9vkv2"]
Jul 18 02:24:38.531215 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:38.531179    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" path="/var/lib/kubelet/pods/e631912a-4805-4363-8cd5-ef83b73bc3af/volumes"
Jul 18 02:24:41.922941 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:41.922904    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"]
Jul 18 02:24:41.923383 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:41.923099    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl" podUID="e6df6a7b-e2f7-4647-b77e-174f3f462982" containerName="maas-api" containerID="cri-o://aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762" gracePeriod=30
Jul 18 02:24:41.952071 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:41.952038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:42.169662 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.169628    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:24:42.270653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.270623    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls\") pod \"e6df6a7b-e2f7-4647-b77e-174f3f462982\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") "
Jul 18 02:24:42.270653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.270665    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6df6a7b-e2f7-4647-b77e-174f3f462982-openshift-service-ca\") pod \"e6df6a7b-e2f7-4647-b77e-174f3f462982\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") "
Jul 18 02:24:42.270880 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.270714    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvtn5\" (UniqueName: \"kubernetes.io/projected/e6df6a7b-e2f7-4647-b77e-174f3f462982-kube-api-access-hvtn5\") pod \"e6df6a7b-e2f7-4647-b77e-174f3f462982\" (UID: \"e6df6a7b-e2f7-4647-b77e-174f3f462982\") "
Jul 18 02:24:42.271119 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.271093    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6df6a7b-e2f7-4647-b77e-174f3f462982-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6df6a7b-e2f7-4647-b77e-174f3f462982" (UID: "e6df6a7b-e2f7-4647-b77e-174f3f462982"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:24:42.273104 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.273073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6df6a7b-e2f7-4647-b77e-174f3f462982" (UID: "e6df6a7b-e2f7-4647-b77e-174f3f462982"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:24:42.273246 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.273107    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6df6a7b-e2f7-4647-b77e-174f3f462982-kube-api-access-hvtn5" (OuterVolumeSpecName: "kube-api-access-hvtn5") pod "e6df6a7b-e2f7-4647-b77e-174f3f462982" (UID: "e6df6a7b-e2f7-4647-b77e-174f3f462982"). InnerVolumeSpecName "kube-api-access-hvtn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:42.371764 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.371723    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6df6a7b-e2f7-4647-b77e-174f3f462982-maas-api-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:42.371764 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.371757    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6df6a7b-e2f7-4647-b77e-174f3f462982-openshift-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:42.371764 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.371767    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvtn5\" (UniqueName: \"kubernetes.io/projected/e6df6a7b-e2f7-4647-b77e-174f3f462982-kube-api-access-hvtn5\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:42.434856 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.434815    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6df6a7b-e2f7-4647-b77e-174f3f462982" containerID="aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762" exitCode=0
Jul 18 02:24:42.435058 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.434871    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"
Jul 18 02:24:42.435058 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.434874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl" event={"ID":"e6df6a7b-e2f7-4647-b77e-174f3f462982","Type":"ContainerDied","Data":"aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762"}
Jul 18 02:24:42.435058 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.434931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl" event={"ID":"e6df6a7b-e2f7-4647-b77e-174f3f462982","Type":"ContainerDied","Data":"108e076ae9968c7517144a5b8b3ff01afc6af93f68b32b696fc62c5fe0d912c7"}
Jul 18 02:24:42.435058 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.434958    2562 scope.go:117] "RemoveContainer" containerID="aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762"
Jul 18 02:24:42.444447 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.444424    2562 scope.go:117] "RemoveContainer" containerID="aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762"
Jul 18 02:24:42.444730 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:24:42.444713    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762\": container with ID starting with aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762 not found: ID does not exist" containerID="aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762"
Jul 18 02:24:42.444785 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.444739    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762"} err="failed to get container status \"aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762\": rpc error: code = NotFound desc = could not find container \"aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762\": container with ID starting with aef9c4939dfeb4718296e04f969a3352e43c0b70a5ee5d38096a918f5b0bc762 not found: ID does not exist"
Jul 18 02:24:42.456230 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.456200    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"]
Jul 18 02:24:42.462261 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.462235    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5eb23f-65dc9697b4-vqxzl"]
Jul 18 02:24:42.531393 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:42.531279    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6df6a7b-e2f7-4647-b77e-174f3f462982" path="/var/lib/kubelet/pods/e6df6a7b-e2f7-4647-b77e-174f3f462982/volumes"
Jul 18 02:24:46.600756 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:46.600717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:46.976668 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:46.976583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:52.862889 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:52.862848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:53.058587 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:53.058550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:53.133991 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:53.133905    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"]
Jul 18 02:24:53.134154 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:53.134137    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" containerID="cri-o://d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4" gracePeriod=30
Jul 18 02:24:53.162368 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:53.162313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:53.378686 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:53.378642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:53.727303 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:53.727265    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:54.051898 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.051863    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"]
Jul 18 02:24:54.052421 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.052277    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy"
Jul 18 02:24:54.052421 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.052294    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy"
Jul 18 02:24:54.052421 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.052312    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6df6a7b-e2f7-4647-b77e-174f3f462982" containerName="maas-api"
Jul 18 02:24:54.052421 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.052332    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6df6a7b-e2f7-4647-b77e-174f3f462982" containerName="maas-api"
Jul 18 02:24:54.052676 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.052424    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy"
Jul 18 02:24:54.052676 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.052438    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy"
Jul 18 02:24:54.052676 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.052449    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6df6a7b-e2f7-4647-b77e-174f3f462982" containerName="maas-api"
Jul 18 02:24:54.056025 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.055996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.063225 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.063185    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c9ff0e-openshift-default-dockercfg-2kvdr\""
Jul 18 02:24:54.071504 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.071474    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"]
Jul 18 02:24:54.091552 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.091509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:54.191783 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.191744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-data\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.191983 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.191788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0622c7f5-4ef5-469a-8b18-1deb81926359-istiod-ca-cert\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.191983 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.191853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-token\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.191983 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.191873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v95qs\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-kube-api-access-v95qs\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.191983 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.191910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-envoy\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.191983 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.191931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-credential-socket\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.192181 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.192029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-socket\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.192181 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.192064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-certs\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.192181 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.192103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-podinfo\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293078 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-socket\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293078 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-certs\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293383 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-podinfo\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293383 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-data\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293383 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0622c7f5-4ef5-469a-8b18-1deb81926359-istiod-ca-cert\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293383 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-token\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293383 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v95qs\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-kube-api-access-v95qs\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293383 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-envoy\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293712 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-credential-socket\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293896 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293870    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-socket\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.293980 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.293922    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-data\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.294024 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.294011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-certs\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.294229 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.294178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-credential-socket\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.294474 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.294454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0622c7f5-4ef5-469a-8b18-1deb81926359-istiod-ca-cert\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.297338 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.297276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-envoy\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.297524 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.297489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-podinfo\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.308729 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.308646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v95qs\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-kube-api-access-v95qs\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.308977 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.308955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-token\") pod \"e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") " pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.367544 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.367505    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:54.392620 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.392587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:54.508248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.508222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"]
Jul 18 02:24:54.510575 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:24:54.510540    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0622c7f5_4ef5_469a_8b18_1deb81926359.slice/crio-634c374eb290e4a912547626006e295cefcf7c31c700ab2c4232c8027bd6b1c2 WatchSource:0}: Error finding container 634c374eb290e4a912547626006e295cefcf7c31c700ab2c4232c8027bd6b1c2: Status 404 returned error can't find the container with id 634c374eb290e4a912547626006e295cefcf7c31c700ab2c4232c8027bd6b1c2
Jul 18 02:24:54.512714 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.512684    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:24:54.512778 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.512753    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:24:54.512822 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:54.512784    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:24:55.500540 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:55.500503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" event={"ID":"0622c7f5-4ef5-469a-8b18-1deb81926359","Type":"ContainerStarted","Data":"552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085"}
Jul 18 02:24:55.500937 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:55.500562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" event={"ID":"0622c7f5-4ef5-469a-8b18-1deb81926359","Type":"ContainerStarted","Data":"634c374eb290e4a912547626006e295cefcf7c31c700ab2c4232c8027bd6b1c2"}
Jul 18 02:24:55.521037 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:55.520983    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podStartSLOduration=1.520964346 podStartE2EDuration="1.520964346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:24:55.518419788 +0000 UTC m=+2202.917819477" watchObservedRunningTime="2026-07-18 02:24:55.520964346 +0000 UTC m=+2202.920364005"
Jul 18 02:24:56.233142 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:56.233088    2562 patch_prober.go:28] interesting pod/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:24:56.233335 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:56.233161    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:24:56.368537 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:56.368505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:56.374037 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:56.374008    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:56.505176 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:56.505142    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:56.506093 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:56.506076    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:24:57.425879 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.425830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:57.519145 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.519106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:57.602012 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.601977    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"]
Jul 18 02:24:57.602390 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.602377    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy"
Jul 18 02:24:57.602447 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.602392    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e631912a-4805-4363-8cd5-ef83b73bc3af" containerName="istio-proxy"
Jul 18 02:24:57.605943 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.605926    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.608239 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.608209    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c9ff0e-serving-cert\""
Jul 18 02:24:57.608370 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.608289    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sfxcd\""
Jul 18 02:24:57.616809 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.616781    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"]
Jul 18 02:24:57.689207 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.689119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:57.729853 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.729821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64ff\" (UniqueName: \"kubernetes.io/projected/91d2dc66-c53b-44ad-8810-af4ac5d92add-kube-api-access-m64ff\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.729995 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.729875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d2dc66-c53b-44ad-8810-af4ac5d92add-openshift-service-ca\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.729995 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.729971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.830993 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.830949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.831210 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.831037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64ff\" (UniqueName: \"kubernetes.io/projected/91d2dc66-c53b-44ad-8810-af4ac5d92add-kube-api-access-m64ff\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.831210 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.831074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d2dc66-c53b-44ad-8810-af4ac5d92add-openshift-service-ca\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.831210 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:24:57.831132    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-serving-cert: secret "maas-api-e2e-api-a-c9ff0e-serving-cert" not found
Jul 18 02:24:57.831419 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:24:57.831227    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls podName:91d2dc66-c53b-44ad-8810-af4ac5d92add nodeName:}" failed. No retries permitted until 2026-07-18 02:24:58.331204472 +0000 UTC m=+2205.730604125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls") pod "maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5" (UID: "91d2dc66-c53b-44ad-8810-af4ac5d92add") : secret "maas-api-e2e-api-a-c9ff0e-serving-cert" not found
Jul 18 02:24:57.831710 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.831692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d2dc66-c53b-44ad-8810-af4ac5d92add-openshift-service-ca\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:57.840227 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:57.840198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64ff\" (UniqueName: \"kubernetes.io/projected/91d2dc66-c53b-44ad-8810-af4ac5d92add-kube-api-access-m64ff\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:58.212102 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.212069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:58.314464 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.314431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:58.335815 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.335781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:58.338437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.338411    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls\") pod \"maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:58.390904 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.390878    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:24:58.415952 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.415858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:24:58.517407 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.517371    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerID="d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4" exitCode=0
Jul 18 02:24:58.517584 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.517424    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"
Jul 18 02:24:58.517584 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.517455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" event={"ID":"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5","Type":"ContainerDied","Data":"d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4"}
Jul 18 02:24:58.517584 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.517522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27" event={"ID":"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5","Type":"ContainerDied","Data":"d635700f475e9adbb52c35dc50307599f7c109d46d8597d9e4517933c6359270"}
Jul 18 02:24:58.517584 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.517563    2562 scope.go:117] "RemoveContainer" containerID="d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4"
Jul 18 02:24:58.517734 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.517609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:58.528772 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.528753    2562 scope.go:117] "RemoveContainer" containerID="dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5"
Jul 18 02:24:58.538384 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538361    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-podinfo\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538517 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-token\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538517 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istiod-ca-cert\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538517 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-envoy\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538651 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m5sb\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-kube-api-access-8m5sb\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538651 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538549    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-data\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538651 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538590    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-credential-socket\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538651 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538647    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-certs\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.538858 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.538672    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-socket\") pod \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\" (UID: \"cb927f2d-9b02-44ae-ab17-45bcfd68f6b5\") "
Jul 18 02:24:58.539313 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.539229    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:58.539313 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.539256    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:58.539524 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.539421    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:58.539593 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.539571    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:24:58.540353 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.540275    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:58.540713 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.540652    2562 scope.go:117] "RemoveContainer" containerID="d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4"
Jul 18 02:24:58.540952 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.540935    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:24:58.541047 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:24:58.541018    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4\": container with ID starting with d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4 not found: ID does not exist" containerID="d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4"
Jul 18 02:24:58.541113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.541047    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4"} err="failed to get container status \"d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4\": rpc error: code = NotFound desc = could not find container \"d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4\": container with ID starting with d9d919f6da30077023b595261b61ed2081a31ff5ae59bbef21bd35d8e59c42f4 not found: ID does not exist"
Jul 18 02:24:58.541113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.541054    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-kube-api-access-8m5sb" (OuterVolumeSpecName: "kube-api-access-8m5sb") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "kube-api-access-8m5sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:58.541113 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.541072    2562 scope.go:117] "RemoveContainer" containerID="dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5"
Jul 18 02:24:58.541274 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.541156    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:24:58.541396 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:24:58.541370    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5\": container with ID starting with dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5 not found: ID does not exist" containerID="dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5"
Jul 18 02:24:58.541494 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.541402    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5"} err="failed to get container status \"dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5\": rpc error: code = NotFound desc = could not find container \"dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5\": container with ID starting with dfc158db5510b83ec54bbbe9af12b3cf9425f9ef3c88ceb196104062b80e77f5 not found: ID does not exist"
Jul 18 02:24:58.541540 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.541509    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" (UID: "cb927f2d-9b02-44ae-ab17-45bcfd68f6b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:24:58.640183 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640112    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640183 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640148    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640183 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640162    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640183 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640174    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640183 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640188    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m5sb\" (UniqueName: \"kubernetes.io/projected/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-kube-api-access-8m5sb\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640554 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640203    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640554 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640217    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640554 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640230    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.640554 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.640245    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:24:58.660213 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.660142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"]
Jul 18 02:24:58.662677 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:24:58.662651    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d2dc66_c53b_44ad_8810_af4ac5d92add.slice/crio-fc0736220572526e46eba1175c43ce20e3c22332f6f6c8b332e9824d65da3fb5 WatchSource:0}: Error finding container fc0736220572526e46eba1175c43ce20e3c22332f6f6c8b332e9824d65da3fb5: Status 404 returned error can't find the container with id fc0736220572526e46eba1175c43ce20e3c22332f6f6c8b332e9824d65da3fb5
Jul 18 02:24:58.848974 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.848938    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"]
Jul 18 02:24:58.866482 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:58.866447    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5eb23f-openshift-default-7fdf76dc49-5lx27"]
Jul 18 02:24:59.524694 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:59.524657    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5" event={"ID":"91d2dc66-c53b-44ad-8810-af4ac5d92add","Type":"ContainerStarted","Data":"ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a"}
Jul 18 02:24:59.524694 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:59.524700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5" event={"ID":"91d2dc66-c53b-44ad-8810-af4ac5d92add","Type":"ContainerStarted","Data":"fc0736220572526e46eba1175c43ce20e3c22332f6f6c8b332e9824d65da3fb5"}
Jul 18 02:24:59.524894 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:59.524862    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:24:59.549658 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:24:59.549600    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5" podStartSLOduration=2.149291988 podStartE2EDuration="2.549582269s" totalImagesPullingTime="400.290281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:24:59.549028096 +0000 UTC m=+2206.948427759" watchObservedRunningTime="2026-07-18 02:24:59.549582269 +0000 UTC m=+2206.948981930"
Jul 18 02:25:00.531230 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:00.531192    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" path="/var/lib/kubelet/pods/cb927f2d-9b02-44ae-ab17-45bcfd68f6b5/volumes"
Jul 18 02:25:00.756643 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:00.756609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:01.922830 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:01.922798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:02.379903 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.379854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:02.650055 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.649973    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"]
Jul 18 02:25:02.650401 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.650388    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy"
Jul 18 02:25:02.650453 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.650402    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy"
Jul 18 02:25:02.650453 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.650412    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy"
Jul 18 02:25:02.650453 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.650418    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy"
Jul 18 02:25:02.650566 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.650478    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy"
Jul 18 02:25:02.650566 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.650492    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb927f2d-9b02-44ae-ab17-45bcfd68f6b5" containerName="istio-proxy"
Jul 18 02:25:02.653935 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.653915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.657015 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.656994    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-21cdac-openshift-default-dockercfg-pfwvp\""
Jul 18 02:25:02.668229 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.668200    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"]
Jul 18 02:25:02.679973 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.679933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd415145-b863-4336-912c-502ee91bbac8-istiod-ca-cert\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680170 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.679998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-socket\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680170 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.680031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-credential-socket\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680170 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.680100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd415145-b863-4336-912c-502ee91bbac8-istio-podinfo\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680374 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.680201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-envoy\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680374 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.680251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzx5l\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-kube-api-access-vzx5l\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680374 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.680364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-data\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680513 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.680404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-certs\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.680513 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.680439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-istio-token\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.690431 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.690399    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:02.781704 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-envoy\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.781911 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzx5l\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-kube-api-access-vzx5l\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.781911 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-data\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.781911 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-certs\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.781911 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-istio-token\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.781911 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd415145-b863-4336-912c-502ee91bbac8-istiod-ca-cert\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782191 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-socket\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782191 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-credential-socket\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782191 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.781977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd415145-b863-4336-912c-502ee91bbac8-istio-podinfo\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782382 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.782236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-data\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782441 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.782390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-certs\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782441 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.782422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-socket\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782550 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.782528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-credential-socket\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.782712 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.782687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd415145-b863-4336-912c-502ee91bbac8-istiod-ca-cert\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.784031 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.784009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-envoy\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.784604 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.784583    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd415145-b863-4336-912c-502ee91bbac8-istio-podinfo\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.789593 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.789566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-istio-token\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.789742 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.789723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzx5l\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-kube-api-access-vzx5l\") pod \"e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") " pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:02.964712 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:02.964622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:03.034759 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.034284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:03.106953 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.106913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"]
Jul 18 02:25:03.110098 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:25:03.110072    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd415145_b863_4336_912c_502ee91bbac8.slice/crio-847b75e2f46867aa998f59a3d2eefc302507c7143197d714c6ed3f97dea36afa WatchSource:0}: Error finding container 847b75e2f46867aa998f59a3d2eefc302507c7143197d714c6ed3f97dea36afa: Status 404 returned error can't find the container with id 847b75e2f46867aa998f59a3d2eefc302507c7143197d714c6ed3f97dea36afa
Jul 18 02:25:03.112203 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.112170    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:03.112284 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.112241    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:03.112284 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.112268    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:03.546057 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.546017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" event={"ID":"fd415145-b863-4336-912c-502ee91bbac8","Type":"ContainerStarted","Data":"1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265"}
Jul 18 02:25:03.546211 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.546078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" event={"ID":"fd415145-b863-4336-912c-502ee91bbac8","Type":"ContainerStarted","Data":"847b75e2f46867aa998f59a3d2eefc302507c7143197d714c6ed3f97dea36afa"}
Jul 18 02:25:03.565850 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.565795    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" podStartSLOduration=1.5657746750000001 podStartE2EDuration="1.565774675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:25:03.564789217 +0000 UTC m=+2210.964188869" watchObservedRunningTime="2026-07-18 02:25:03.565774675 +0000 UTC m=+2210.965174341"
Jul 18 02:25:03.965420 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:03.965303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:04.970786 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:04.970754    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:05.535338 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:05.535292    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:25:05.542940 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:05.542908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:05.555184 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:05.555156    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:05.556172 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:05.556151    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:05.630661 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:05.630614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:05.760252 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:05.760214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:06.211749 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:06.211712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:06.310023 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:06.309988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:06.414296 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:06.414186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:10.000412 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:10.000366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:11.507902 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.507858    2562 patch_prober.go:28] interesting pod/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 18 02:25:11.508528 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.507918    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 18 02:25:11.607395 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.607355    2562 generic.go:356] "Generic (PLEG): container finished" podID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerID="552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085" exitCode=0
Jul 18 02:25:11.607572 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.607429    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" event={"ID":"0622c7f5-4ef5-469a-8b18-1deb81926359","Type":"ContainerDied","Data":"552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085"}
Jul 18 02:25:11.608005 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.607983    2562 scope.go:117] "RemoveContainer" containerID="552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085"
Jul 18 02:25:11.609181 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.609152    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:11.609282 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.609237    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:11.609374 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:11.609284    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:12.618117 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:12.618078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" event={"ID":"0622c7f5-4ef5-469a-8b18-1deb81926359","Type":"ContainerStarted","Data":"55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2"}
Jul 18 02:25:13.368568 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:13.368531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:25:13.368741 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:13.368694    2562 patch_prober.go:28] interesting pod/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 18 02:25:13.368787 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:13.368755    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 18 02:25:14.368794 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:14.368755    2562 patch_prober.go:28] interesting pod/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 18 02:25:14.369209 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:14.368815    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 18 02:25:15.367888 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:15.367848    2562 patch_prober.go:28] interesting pod/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 18 02:25:15.368082 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:15.367909    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 18 02:25:16.368818 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:16.368776    2562 patch_prober.go:28] interesting pod/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 18 02:25:16.369249 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:16.368836    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 18 02:25:17.372220 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.372186    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:25:17.373727 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.372595    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:25:17.373727 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.373261    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:25:17.649897 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.649778    2562 generic.go:356] "Generic (PLEG): container finished" podID="fd415145-b863-4336-912c-502ee91bbac8" containerID="1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265" exitCode=0
Jul 18 02:25:17.649897 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.649854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" event={"ID":"fd415145-b863-4336-912c-502ee91bbac8","Type":"ContainerDied","Data":"1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265"}
Jul 18 02:25:17.650396 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.650379    2562 scope.go:117] "RemoveContainer" containerID="1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265"
Jul 18 02:25:17.651405 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.651378    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:17.651507 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.651451    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:17.651507 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:17.651482    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:25:18.656773 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:18.656735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" event={"ID":"fd415145-b863-4336-912c-502ee91bbac8","Type":"ContainerStarted","Data":"5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396"}
Jul 18 02:25:18.822434 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:18.822355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:18.926252 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:18.926137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:18.964938 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:18.964896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:18.966148 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:18.966125    2562 patch_prober.go:28] interesting pod/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 18 02:25:18.966212 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:18.966178    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 18 02:25:19.965505 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:19.965468    2562 patch_prober.go:28] interesting pod/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 18 02:25:19.965894 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:19.965524    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 18 02:25:20.555533 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:20.555497    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:20.965456 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:20.965357    2562 patch_prober.go:28] interesting pod/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 18 02:25:20.965456 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:20.965419    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 18 02:25:21.965202 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:21.965159    2562 patch_prober.go:28] interesting pod/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 18 02:25:21.965424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:21.965218    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 18 02:25:22.969864 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:22.969830    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:22.970890 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:22.970869    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:25:27.118644 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:27.118591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:27.219561 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:27.219529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:28.678418 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:28.678372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:28.816420 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:28.816356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:34.018404 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.018371    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"]
Jul 18 02:25:34.018828 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.018581    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5" podUID="91d2dc66-c53b-44ad-8810-af4ac5d92add" containerName="maas-api" containerID="cri-o://ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a" gracePeriod=30
Jul 18 02:25:34.047099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.047070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:34.269921 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.269857    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:25:34.326738 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.323669    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d2dc66-c53b-44ad-8810-af4ac5d92add-openshift-service-ca\") pod \"91d2dc66-c53b-44ad-8810-af4ac5d92add\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") "
Jul 18 02:25:34.326738 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.323729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m64ff\" (UniqueName: \"kubernetes.io/projected/91d2dc66-c53b-44ad-8810-af4ac5d92add-kube-api-access-m64ff\") pod \"91d2dc66-c53b-44ad-8810-af4ac5d92add\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") "
Jul 18 02:25:34.326738 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.323826    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls\") pod \"91d2dc66-c53b-44ad-8810-af4ac5d92add\" (UID: \"91d2dc66-c53b-44ad-8810-af4ac5d92add\") "
Jul 18 02:25:34.326738 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.324790    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d2dc66-c53b-44ad-8810-af4ac5d92add-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91d2dc66-c53b-44ad-8810-af4ac5d92add" (UID: "91d2dc66-c53b-44ad-8810-af4ac5d92add"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:34.329377 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.327612    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91d2dc66-c53b-44ad-8810-af4ac5d92add" (UID: "91d2dc66-c53b-44ad-8810-af4ac5d92add"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:25:34.329377 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.327809    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d2dc66-c53b-44ad-8810-af4ac5d92add-kube-api-access-m64ff" (OuterVolumeSpecName: "kube-api-access-m64ff") pod "91d2dc66-c53b-44ad-8810-af4ac5d92add" (UID: "91d2dc66-c53b-44ad-8810-af4ac5d92add"). InnerVolumeSpecName "kube-api-access-m64ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:34.425865 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.425830    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91d2dc66-c53b-44ad-8810-af4ac5d92add-maas-api-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:34.425865 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.425862    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d2dc66-c53b-44ad-8810-af4ac5d92add-openshift-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:34.425865 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.425874    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m64ff\" (UniqueName: \"kubernetes.io/projected/91d2dc66-c53b-44ad-8810-af4ac5d92add-kube-api-access-m64ff\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:34.739041 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.739005    2562 generic.go:356] "Generic (PLEG): container finished" podID="91d2dc66-c53b-44ad-8810-af4ac5d92add" containerID="ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a" exitCode=0
Jul 18 02:25:34.739219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.739067    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"
Jul 18 02:25:34.739219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.739098    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5" event={"ID":"91d2dc66-c53b-44ad-8810-af4ac5d92add","Type":"ContainerDied","Data":"ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a"}
Jul 18 02:25:34.739219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.739153    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5" event={"ID":"91d2dc66-c53b-44ad-8810-af4ac5d92add","Type":"ContainerDied","Data":"fc0736220572526e46eba1175c43ce20e3c22332f6f6c8b332e9824d65da3fb5"}
Jul 18 02:25:34.739219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.739175    2562 scope.go:117] "RemoveContainer" containerID="ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a"
Jul 18 02:25:34.747729 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.747710    2562 scope.go:117] "RemoveContainer" containerID="ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a"
Jul 18 02:25:34.748013 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:25:34.747994    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a\": container with ID starting with ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a not found: ID does not exist" containerID="ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a"
Jul 18 02:25:34.748081 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.748024    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a"} err="failed to get container status \"ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a\": rpc error: code = NotFound desc = could not find container \"ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a\": container with ID starting with ea7bf363e669fb597d0ecde1b17b728454acca2cb983eb302c8f2c3759f9d40a not found: ID does not exist"
Jul 18 02:25:34.754617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.754593    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"]
Jul 18 02:25:34.758380 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:34.758360    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c9ff0e-796668dd94-2tbj5"]
Jul 18 02:25:36.531916 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:36.531872    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d2dc66-c53b-44ad-8810-af4ac5d92add" path="/var/lib/kubelet/pods/91d2dc66-c53b-44ad-8810-af4ac5d92add/volumes"
Jul 18 02:25:38.080866 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:38.080835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:38.449430 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:38.449314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:44.100362 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:44.100304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:44.193873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:44.193838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:44.328486 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:44.328449    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"]
Jul 18 02:25:44.328777 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:44.328750    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy" containerID="cri-o://55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2" gracePeriod=30
Jul 18 02:25:44.355242 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:44.355163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:44.589174 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:44.589132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:45.433233 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:45.433198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:45.533427 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:45.533393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:25:47.375760 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:47.375719    2562 patch_prober.go:28] interesting pod/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 18 02:25:47.376243 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:47.375786    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:25:49.581508 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.581484    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:25:49.686432 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686300    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0622c7f5-4ef5-469a-8b18-1deb81926359-istiod-ca-cert\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686432 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686399    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-certs\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686432 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686428    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-podinfo\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-data\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686475    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-envoy\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686515    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-credential-socket\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686561    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-token\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-socket\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.686732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686619    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v95qs\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-kube-api-access-v95qs\") pod \"0622c7f5-4ef5-469a-8b18-1deb81926359\" (UID: \"0622c7f5-4ef5-469a-8b18-1deb81926359\") "
Jul 18 02:25:49.687047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686769    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:49.687047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686773    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0622c7f5-4ef5-469a-8b18-1deb81926359-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:49.687047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686866    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:49.687047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.686978    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:49.687047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.687014    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0622c7f5-4ef5-469a-8b18-1deb81926359-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.687047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.687033    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.687047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.687047    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.687599 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.687568    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-data" (OuterVolumeSpecName: "istio-data") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:49.688837 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.688813    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-token" (OuterVolumeSpecName: "istio-token") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:49.688837 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.688817    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:25:49.688987 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.688911    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:25:49.688987 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.688946    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-kube-api-access-v95qs" (OuterVolumeSpecName: "kube-api-access-v95qs") pod "0622c7f5-4ef5-469a-8b18-1deb81926359" (UID: "0622c7f5-4ef5-469a-8b18-1deb81926359"). InnerVolumeSpecName "kube-api-access-v95qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:49.788204 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.788160    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.788204 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.788198    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.788204 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.788208    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v95qs\" (UniqueName: \"kubernetes.io/projected/0622c7f5-4ef5-469a-8b18-1deb81926359-kube-api-access-v95qs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.788204 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.788219    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.788548 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.788229    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.788548 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.788238    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0622c7f5-4ef5-469a-8b18-1deb81926359-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:25:49.817145 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.817105    2562 generic.go:356] "Generic (PLEG): container finished" podID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerID="55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2" exitCode=0
Jul 18 02:25:49.817352 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.817181    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"
Jul 18 02:25:49.817352 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.817200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" event={"ID":"0622c7f5-4ef5-469a-8b18-1deb81926359","Type":"ContainerDied","Data":"55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2"}
Jul 18 02:25:49.817352 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.817285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p" event={"ID":"0622c7f5-4ef5-469a-8b18-1deb81926359","Type":"ContainerDied","Data":"634c374eb290e4a912547626006e295cefcf7c31c700ab2c4232c8027bd6b1c2"}
Jul 18 02:25:49.817352 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.817312    2562 scope.go:117] "RemoveContainer" containerID="55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2"
Jul 18 02:25:49.828663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.828503    2562 scope.go:117] "RemoveContainer" containerID="552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085"
Jul 18 02:25:49.838040 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.838017    2562 scope.go:117] "RemoveContainer" containerID="55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2"
Jul 18 02:25:49.838394 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:25:49.838372    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2\": container with ID starting with 55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2 not found: ID does not exist" containerID="55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2"
Jul 18 02:25:49.838477 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.838404    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2"} err="failed to get container status \"55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2\": rpc error: code = NotFound desc = could not find container \"55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2\": container with ID starting with 55c495a6e7b691a82555a18f78410b00cb07c9e23fb43ae5518d32ade1485bc2 not found: ID does not exist"
Jul 18 02:25:49.838477 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.838425    2562 scope.go:117] "RemoveContainer" containerID="552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085"
Jul 18 02:25:49.838635 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:25:49.838620    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085\": container with ID starting with 552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085 not found: ID does not exist" containerID="552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085"
Jul 18 02:25:49.838676 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.838638    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085"} err="failed to get container status \"552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085\": rpc error: code = NotFound desc = could not find container \"552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085\": container with ID starting with 552b22f81909bb3c12d7bd922e4b19371957b809359f725bf47c15693e443085 not found: ID does not exist"
Jul 18 02:25:49.844711 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.844681    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"]
Jul 18 02:25:49.849511 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:49.849484    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c9ff0e-openshift-default-b9dd9f5c7-hw65p"]
Jul 18 02:25:50.531963 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:25:50.531932    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" path="/var/lib/kubelet/pods/0622c7f5-4ef5-469a-8b18-1deb81926359/volumes"
Jul 18 02:26:00.180340 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:00.180297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:04.782561 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:04.782525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:05.157024 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:05.156930    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:10.890468 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:10.890437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:10.989615 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:10.989576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:11.114518 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:11.114484    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"]
Jul 18 02:26:11.114727 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:11.114705    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy" containerID="cri-o://5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396" gracePeriod=30
Jul 18 02:26:11.135257 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:11.135217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:11.376103 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:11.376068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:11.730772 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:11.730670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:12.012760 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.012723    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"]
Jul 18 02:26:12.013220 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013125    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy"
Jul 18 02:26:12.013220 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013137    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy"
Jul 18 02:26:12.013220 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013146    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy"
Jul 18 02:26:12.013220 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013153    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy"
Jul 18 02:26:12.013220 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013166    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d2dc66-c53b-44ad-8810-af4ac5d92add" containerName="maas-api"
Jul 18 02:26:12.013220 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013172    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d2dc66-c53b-44ad-8810-af4ac5d92add" containerName="maas-api"
Jul 18 02:26:12.013527 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013262    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy"
Jul 18 02:26:12.013527 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.013276    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d2dc66-c53b-44ad-8810-af4ac5d92add" containerName="maas-api"
Jul 18 02:26:12.015494 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.015473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.017853 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.017832    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-2cb736-openshift-default-dockercfg-qwg4p\""
Jul 18 02:26:12.031336 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.031297    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"]
Jul 18 02:26:12.041524 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.041458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:12.107649 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-token\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.107649 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-certs\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.107873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-credential-socket\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.107873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-envoy\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.107873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-podinfo\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.107873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-data\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.107873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-socket\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.108047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29294fd7-a960-462f-861b-6b2cf26ad8a5-istiod-ca-cert\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.108047 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.107941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfmp8\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-kube-api-access-hfmp8\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.208761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29294fd7-a960-462f-861b-6b2cf26ad8a5-istiod-ca-cert\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.208761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfmp8\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-kube-api-access-hfmp8\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-token\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-certs\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-credential-socket\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-envoy\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-podinfo\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.208966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-data\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.209011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-socket\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209411 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.209358    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-certs\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209411 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.209403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-data\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209500 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.209437    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-credential-socket\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209500 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.209480    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-socket\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.209629 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.209609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29294fd7-a960-462f-861b-6b2cf26ad8a5-istiod-ca-cert\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.211409 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.211383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-envoy\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.211621 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.211595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-podinfo\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.216966 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.216938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfmp8\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-kube-api-access-hfmp8\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.217067 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.216928    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-token\") pod \"e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") " pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.325788 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.325693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:12.376671 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.376630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:12.468099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.466924    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"]
Jul 18 02:26:12.469894 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:26:12.469862    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29294fd7_a960_462f_861b_6b2cf26ad8a5.slice/crio-8907660f85607eaa845d76ac78238fe117cb48a8fdce5d167861c801dc063b3a WatchSource:0}: Error finding container 8907660f85607eaa845d76ac78238fe117cb48a8fdce5d167861c801dc063b3a: Status 404 returned error can't find the container with id 8907660f85607eaa845d76ac78238fe117cb48a8fdce5d167861c801dc063b3a
Jul 18 02:26:12.472112 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.472080    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:12.472189 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.472152    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:12.472189 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.472181    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:12.929421 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.929387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" event={"ID":"29294fd7-a960-462f-861b-6b2cf26ad8a5","Type":"ContainerStarted","Data":"931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f"}
Jul 18 02:26:12.929923 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.929443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" event={"ID":"29294fd7-a960-462f-861b-6b2cf26ad8a5","Type":"ContainerStarted","Data":"8907660f85607eaa845d76ac78238fe117cb48a8fdce5d167861c801dc063b3a"}
Jul 18 02:26:12.950414 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:12.950361    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podStartSLOduration=1.950343407 podStartE2EDuration="1.950343407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:12.949263007 +0000 UTC m=+2280.348662667" watchObservedRunningTime="2026-07-18 02:26:12.950343407 +0000 UTC m=+2280.349743060"
Jul 18 02:26:13.326405 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:13.326360    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:13.331511 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:13.331478    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:13.935082 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:13.935049    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:13.936088 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:13.936065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:14.874022 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.873992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:14.970808 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.970772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:14.979504 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.979477    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"]
Jul 18 02:26:14.979938 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.979922    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0622c7f5-4ef5-469a-8b18-1deb81926359" containerName="istio-proxy"
Jul 18 02:26:14.984400 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.984380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:14.986809 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.986782    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-2cb736-serving-cert\""
Jul 18 02:26:14.987303 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.987279    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sfxcd\""
Jul 18 02:26:14.996159 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:14.996130    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"]
Jul 18 02:26:15.038202 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.038164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/0ea2ec60-6431-43b0-863f-eeb96c54c11b-kube-api-access-z5964\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.038438 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.038225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea2ec60-6431-43b0-863f-eeb96c54c11b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.038595 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.038571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.066833 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.066797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:15.139819 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.139728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/0ea2ec60-6431-43b0-863f-eeb96c54c11b-kube-api-access-z5964\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.139819 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.139789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea2ec60-6431-43b0-863f-eeb96c54c11b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.140035 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.139847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.140035 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:26:15.139981    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-serving-cert: secret "maas-api-e2e-shared-a-2cb736-serving-cert" not found
Jul 18 02:26:15.140116 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:26:15.140057    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls podName:0ea2ec60-6431-43b0-863f-eeb96c54c11b nodeName:}" failed. No retries permitted until 2026-07-18 02:26:15.640035392 +0000 UTC m=+2283.039435042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls") pod "maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng" (UID: "0ea2ec60-6431-43b0-863f-eeb96c54c11b") : secret "maas-api-e2e-shared-a-2cb736-serving-cert" not found
Jul 18 02:26:15.140445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.140428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea2ec60-6431-43b0-863f-eeb96c54c11b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.153645 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.153620    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/0ea2ec60-6431-43b0-863f-eeb96c54c11b-kube-api-access-z5964\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.232399 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.232362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:15.563234 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.563198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:15.644626 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.644590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.647203 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.647172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls\") pod \"maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:15.664563 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.664529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:15.896881 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:15.896794    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:16.041925 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.041899    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"]
Jul 18 02:26:16.043571 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:26:16.043542    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea2ec60_6431_43b0_863f_eeb96c54c11b.slice/crio-c570c3a8a1e65bc680d03645ef87d5e2ca0263be1f805be40b3b736d421a7a07 WatchSource:0}: Error finding container c570c3a8a1e65bc680d03645ef87d5e2ca0263be1f805be40b3b736d421a7a07: Status 404 returned error can't find the container with id c570c3a8a1e65bc680d03645ef87d5e2ca0263be1f805be40b3b736d421a7a07
Jul 18 02:26:16.371142 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.371114    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:26:16.451798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.451701    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-istio-token\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.451798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.451758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-socket\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.451807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-data\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.451846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzx5l\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-kube-api-access-vzx5l\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.451869    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-certs\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.451909    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd415145-b863-4336-912c-502ee91bbac8-istiod-ca-cert\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452050 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.451952    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-credential-socket\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452305 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452055    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd415145-b863-4336-912c-502ee91bbac8-istio-podinfo\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452305 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452081    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-envoy\") pod \"fd415145-b863-4336-912c-502ee91bbac8\" (UID: \"fd415145-b863-4336-912c-502ee91bbac8\") "
Jul 18 02:26:16.452305 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452156    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:16.452521 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452368    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:16.452521 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452461    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd415145-b863-4336-912c-502ee91bbac8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:26:16.452521 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452477    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.452521 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452284    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:16.452521 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452495    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.452752 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.452666    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:16.454227 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.454203    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-kube-api-access-vzx5l" (OuterVolumeSpecName: "kube-api-access-vzx5l") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "kube-api-access-vzx5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:26:16.454350 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.454235    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:26:16.454460 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.454444    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:26:16.454562 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.454547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd415145-b863-4336-912c-502ee91bbac8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd415145-b863-4336-912c-502ee91bbac8" (UID: "fd415145-b863-4336-912c-502ee91bbac8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:26:16.553861 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.553826    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.553861 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.553855    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzx5l\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-kube-api-access-vzx5l\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.553861 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.553865    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.554099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.553873    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd415145-b863-4336-912c-502ee91bbac8-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.554099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.553881    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd415145-b863-4336-912c-502ee91bbac8-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.554099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.553889    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd415145-b863-4336-912c-502ee91bbac8-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.554099 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.553897    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd415145-b863-4336-912c-502ee91bbac8-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:26:16.951713 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.951673    2562 generic.go:356] "Generic (PLEG): container finished" podID="fd415145-b863-4336-912c-502ee91bbac8" containerID="5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396" exitCode=0
Jul 18 02:26:16.952211 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.951745    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"
Jul 18 02:26:16.952211 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.951750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" event={"ID":"fd415145-b863-4336-912c-502ee91bbac8","Type":"ContainerDied","Data":"5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396"}
Jul 18 02:26:16.952211 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.951846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq" event={"ID":"fd415145-b863-4336-912c-502ee91bbac8","Type":"ContainerDied","Data":"847b75e2f46867aa998f59a3d2eefc302507c7143197d714c6ed3f97dea36afa"}
Jul 18 02:26:16.952211 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.951907    2562 scope.go:117] "RemoveContainer" containerID="5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396"
Jul 18 02:26:16.953649 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.953624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng" event={"ID":"0ea2ec60-6431-43b0-863f-eeb96c54c11b","Type":"ContainerStarted","Data":"ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735"}
Jul 18 02:26:16.953775 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.953674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng" event={"ID":"0ea2ec60-6431-43b0-863f-eeb96c54c11b","Type":"ContainerStarted","Data":"c570c3a8a1e65bc680d03645ef87d5e2ca0263be1f805be40b3b736d421a7a07"}
Jul 18 02:26:16.953775 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.953744    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:16.961251 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.961227    2562 scope.go:117] "RemoveContainer" containerID="1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265"
Jul 18 02:26:16.970031 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.970009    2562 scope.go:117] "RemoveContainer" containerID="5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396"
Jul 18 02:26:16.970376 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:26:16.970352    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396\": container with ID starting with 5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396 not found: ID does not exist" containerID="5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396"
Jul 18 02:26:16.970432 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.970388    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396"} err="failed to get container status \"5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396\": rpc error: code = NotFound desc = could not find container \"5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396\": container with ID starting with 5198d0a5cfa85acbab12a38dd52a003f6afc95eb5327b3c9e3d45aacc643d396 not found: ID does not exist"
Jul 18 02:26:16.970432 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.970407    2562 scope.go:117] "RemoveContainer" containerID="1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265"
Jul 18 02:26:16.970681 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:26:16.970662    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265\": container with ID starting with 1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265 not found: ID does not exist" containerID="1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265"
Jul 18 02:26:16.970740 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.970688    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265"} err="failed to get container status \"1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265\": rpc error: code = NotFound desc = could not find container \"1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265\": container with ID starting with 1c40a0bd870f82168e80bfc439adaf7e49a815fc51c7a95091736ae5e9aeb265 not found: ID does not exist"
Jul 18 02:26:16.975062 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.975012    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng" podStartSLOduration=2.532448245 podStartE2EDuration="2.974996849s" totalImagesPullingTime="442.548604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:16.9733931 +0000 UTC m=+2284.372792760" watchObservedRunningTime="2026-07-18 02:26:16.974996849 +0000 UTC m=+2284.374396508"
Jul 18 02:26:16.987816 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.987778    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"]
Jul 18 02:26:16.992034 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:16.992003    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-21cdac-openshift-default-6cdc84f9d5-jc9sq"]
Jul 18 02:26:18.531726 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:18.531692    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd415145-b863-4336-912c-502ee91bbac8" path="/var/lib/kubelet/pods/fd415145-b863-4336-912c-502ee91bbac8/volumes"
Jul 18 02:26:19.377762 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.377726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:19.685551 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.685463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:19.954190 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.954103    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"]
Jul 18 02:26:19.954631 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.954609    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy"
Jul 18 02:26:19.954631 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.954632    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy"
Jul 18 02:26:19.954798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.954655    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy"
Jul 18 02:26:19.954798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.954663    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy"
Jul 18 02:26:19.954798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.954776    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy"
Jul 18 02:26:19.954798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.954789    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd415145-b863-4336-912c-502ee91bbac8" containerName="istio-proxy"
Jul 18 02:26:19.958030 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.958007    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:19.960424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.960395    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-16c040-openshift-default-dockercfg-vk7bd\""
Jul 18 02:26:19.970403 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.970376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"]
Jul 18 02:26:19.988998 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:19.988962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:20.089617 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-certs\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.089834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-credential-socket\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.089834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-data\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.089834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-socket\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.089834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istiod-ca-cert\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.089834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-podinfo\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.089834 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-envoy\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.090118 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-token\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.090118 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.089953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr8mp\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-kube-api-access-wr8mp\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.190877 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.190832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istiod-ca-cert\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.190877 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.190881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-podinfo\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191138 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.190948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-envoy\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191138 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-token\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191138 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr8mp\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-kube-api-access-wr8mp\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191138 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-certs\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191384 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-credential-socket\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191384 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-data\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191495 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-socket\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191549 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-certs\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191752 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istiod-ca-cert\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-data\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191732    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-socket\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.191873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.191774    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-credential-socket\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.193400 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.193381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-envoy\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.193849 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.193826    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-podinfo\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.198761 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.198727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-token\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.198901 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.198880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr8mp\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-kube-api-access-wr8mp\") pod \"e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") " pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.270717 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.270664    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:20.410877 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.410840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"]
Jul 18 02:26:20.414203 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:26:20.414171    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ed23ea_368e_4ff1_a7eb_72cb7214cc81.slice/crio-9becbc43dde60332af2be38f4da89a2c36ecfd7073865eb2872fd4472ab53304 WatchSource:0}: Error finding container 9becbc43dde60332af2be38f4da89a2c36ecfd7073865eb2872fd4472ab53304: Status 404 returned error can't find the container with id 9becbc43dde60332af2be38f4da89a2c36ecfd7073865eb2872fd4472ab53304
Jul 18 02:26:20.416510 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.416479    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:20.416592 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.416559    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:20.416632 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.416593    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:20.566190 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.566087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:20.978367 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.978248    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" event={"ID":"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81","Type":"ContainerStarted","Data":"38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461"}
Jul 18 02:26:20.978367 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.978304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" event={"ID":"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81","Type":"ContainerStarted","Data":"9becbc43dde60332af2be38f4da89a2c36ecfd7073865eb2872fd4472ab53304"}
Jul 18 02:26:20.999131 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:20.999075    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podStartSLOduration=1.999057611 podStartE2EDuration="1.999057611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:20.997967591 +0000 UTC m=+2288.397367251" watchObservedRunningTime="2026-07-18 02:26:20.999057611 +0000 UTC m=+2288.398457271"
Jul 18 02:26:21.271671 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:21.271640    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:21.276905 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:21.276880    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:21.983410 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:21.983367    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:21.984498 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:21.984479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:22.939248 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:22.939217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:22.965892 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:22.965864    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:26:23.068814 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:23.068755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:23.169396 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:23.169360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:23.424607 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:23.424572    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:23.602830 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:23.602781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:23.705221 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:23.705130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:27.368708 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:27.368675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:29.977561 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:29.977518    2562 patch_prober.go:28] interesting pod/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 18 02:26:29.978005 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:29.977598    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 18 02:26:31.039215 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:31.039178    2562 generic.go:356] "Generic (PLEG): container finished" podID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerID="931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f" exitCode=0
Jul 18 02:26:31.039685 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:31.039252    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" event={"ID":"29294fd7-a960-462f-861b-6b2cf26ad8a5","Type":"ContainerDied","Data":"931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f"}
Jul 18 02:26:31.039732 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:31.039691    2562 scope.go:117] "RemoveContainer" containerID="931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f"
Jul 18 02:26:31.040832 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:31.040803    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:31.040893 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:31.040877    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:31.040930 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:31.040911    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:32.046550 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:32.046513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" event={"ID":"29294fd7-a960-462f-861b-6b2cf26ad8a5","Type":"ContainerStarted","Data":"e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec"}
Jul 18 02:26:32.326896 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:32.326798    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:32.327243 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:32.327215    2562 patch_prober.go:28] interesting pod/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 18 02:26:32.327448 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:32.327421    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 18 02:26:33.326873 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:33.326829    2562 patch_prober.go:28] interesting pod/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 18 02:26:33.327512 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:33.327480    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 18 02:26:34.326588 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:34.326545    2562 patch_prober.go:28] interesting pod/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 18 02:26:34.327358 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:34.326883    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 18 02:26:35.326498 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:35.326461    2562 patch_prober.go:28] interesting pod/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 18 02:26:35.326680 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:35.326521    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 18 02:26:36.329450 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:36.329408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:36.330022 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:36.330000    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:36.330843 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:36.330820    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:26:36.373281 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:36.373225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:36.567495 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:36.567462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:37.862519 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:37.862070    2562 patch_prober.go:28] interesting pod/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:38556->10.134.0.56:15021: read: connection reset by peer" start-of-body=
Jul 18 02:26:37.862519 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:37.862154    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:38556->10.134.0.56:15021: read: connection reset by peer"
Jul 18 02:26:38.088024 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:38.087938    2562 generic.go:356] "Generic (PLEG): container finished" podID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerID="38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461" exitCode=0
Jul 18 02:26:38.088195 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:38.088017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" event={"ID":"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81","Type":"ContainerDied","Data":"38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461"}
Jul 18 02:26:38.088611 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:38.088596    2562 scope.go:117] "RemoveContainer" containerID="38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461"
Jul 18 02:26:38.089613 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:38.089589    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:38.089677 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:38.089657    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:38.089723 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:38.089689    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 18 02:26:39.100257 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:39.100209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" event={"ID":"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81","Type":"ContainerStarted","Data":"ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b"}
Jul 18 02:26:39.271215 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:39.271169    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:39.271448 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:39.271395    2562 patch_prober.go:28] interesting pod/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 18 02:26:39.271500 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:39.271445    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 18 02:26:40.271384 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:40.271315    2562 patch_prober.go:28] interesting pod/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 18 02:26:40.271779 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:40.271406    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 18 02:26:40.742193 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:40.742105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:41.271188 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:41.271147    2562 patch_prober.go:28] interesting pod/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 18 02:26:41.271440 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:41.271208    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 18 02:26:42.271893 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:42.271855    2562 patch_prober.go:28] interesting pod/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 18 02:26:42.272277 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:42.271913    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 18 02:26:43.274583 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:43.274555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:43.275036 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:43.274834    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:43.275509 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:43.275491    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:26:45.476812 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:45.476772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:26:45.568765 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:26:45.568727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:27:25.409758 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:27:25.409715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:27:43.581495 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:27:43.581457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:27:43.682953 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:27:43.682920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:28:16.562731 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:28:16.562690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:28:16.616616 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:28:16.616575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:28:50.545200 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:28:50.545120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:29:35.881905 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:35.881867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:29:36.943897 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:36.943863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:29:50.587854 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.587815    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"]
Jul 18 02:29:50.592255 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.592230    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.594654 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.594628    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"kube-root-ca.crt\""
Jul 18 02:29:50.595273 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.595251    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"default-dockercfg-nxh2s\""
Jul 18 02:29:50.595623 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.595297    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"openshift-service-ca.crt\""
Jul 18 02:29:50.595623 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.595346    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2cb736\"/\"sub-test-model-2cb736-kserve-self-signed-certs\""
Jul 18 02:29:50.598642 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.598616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"]
Jul 18 02:29:50.618136 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.618099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:29:50.695434 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.695397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-dshm\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.695615 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.695468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ff28\" (UniqueName: \"kubernetes.io/projected/0895e978-211f-4a2a-b9cb-330e0d36000b-kube-api-access-6ff28\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.695615 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.695501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-model-cache\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.695615 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.695522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-tmp-dir\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.695729 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.695617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0895e978-211f-4a2a-b9cb-330e0d36000b-tls-certs\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.695729 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.695650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-home\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.796831 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.796786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-home\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797015 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.796858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-dshm\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797015 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.796907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ff28\" (UniqueName: \"kubernetes.io/projected/0895e978-211f-4a2a-b9cb-330e0d36000b-kube-api-access-6ff28\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797015 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.796933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-model-cache\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797015 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.796956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-tmp-dir\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797177 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.797018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0895e978-211f-4a2a-b9cb-330e0d36000b-tls-certs\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797297 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.797273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-home\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797368 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.797313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-model-cache\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.797483 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.797464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-tmp-dir\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.799274 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.799244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-dshm\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.799591 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.799571    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0895e978-211f-4a2a-b9cb-330e0d36000b-tls-certs\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.804982 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.804953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ff28\" (UniqueName: \"kubernetes.io/projected/0895e978-211f-4a2a-b9cb-330e0d36000b-kube-api-access-6ff28\") pod \"sub-test-model-2cb736-kserve-5bc46f777-ncdhg\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") " pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:50.904512 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:50.904412    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:29:51.042188 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:51.042162    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"]
Jul 18 02:29:51.044266 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:29:51.044239    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0895e978_211f_4a2a_b9cb_330e0d36000b.slice/crio-67831d606942315285893015addb8953f02921bbedb4331489a968cc40b093d8 WatchSource:0}: Error finding container 67831d606942315285893015addb8953f02921bbedb4331489a968cc40b093d8: Status 404 returned error can't find the container with id 67831d606942315285893015addb8953f02921bbedb4331489a968cc40b093d8
Jul 18 02:29:51.074190 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:51.074156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg" event={"ID":"0895e978-211f-4a2a-b9cb-330e0d36000b","Type":"ContainerStarted","Data":"67831d606942315285893015addb8953f02921bbedb4331489a968cc40b093d8"}
Jul 18 02:29:52.080583 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:52.080536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg" event={"ID":"0895e978-211f-4a2a-b9cb-330e0d36000b","Type":"ContainerStarted","Data":"008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c"}
Jul 18 02:29:52.097696 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:29:52.097648    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg" podStartSLOduration=2.097632392 podStartE2EDuration="2.097632392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:29:52.095513611 +0000 UTC m=+2499.494913288" watchObservedRunningTime="2026-07-18 02:29:52.097632392 +0000 UTC m=+2499.497032050"
Jul 18 02:30:00.905472 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:00.905418    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:30:00.905991 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:00.905751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:30:00.918370 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:00.918317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:30:01.135682 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:01.135652    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:30:06.089887 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:06.089786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:30:06.191483 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:06.191451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:30:09.210223 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:09.210190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:30:50.649148 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:50.649108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:30:59.989572 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:30:59.989535    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"]
Jul 18 02:31:00.008420 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:00.008380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:31:00.913115 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:00.913078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:31:15.010817 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.010765    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg" podUID="0895e978-211f-4a2a-b9cb-330e0d36000b" containerName="main" containerID="cri-o://008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c" gracePeriod=45
Jul 18 02:31:15.265510 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.265448    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:31:15.337772 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.337731    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-home\") pod \"0895e978-211f-4a2a-b9cb-330e0d36000b\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") "
Jul 18 02:31:15.337772 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.337779    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-dshm\") pod \"0895e978-211f-4a2a-b9cb-330e0d36000b\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") "
Jul 18 02:31:15.337996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.337814    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ff28\" (UniqueName: \"kubernetes.io/projected/0895e978-211f-4a2a-b9cb-330e0d36000b-kube-api-access-6ff28\") pod \"0895e978-211f-4a2a-b9cb-330e0d36000b\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") "
Jul 18 02:31:15.337996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.337881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-model-cache\") pod \"0895e978-211f-4a2a-b9cb-330e0d36000b\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") "
Jul 18 02:31:15.337996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.337905    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0895e978-211f-4a2a-b9cb-330e0d36000b-tls-certs\") pod \"0895e978-211f-4a2a-b9cb-330e0d36000b\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") "
Jul 18 02:31:15.337996 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.337966    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-tmp-dir\") pod \"0895e978-211f-4a2a-b9cb-330e0d36000b\" (UID: \"0895e978-211f-4a2a-b9cb-330e0d36000b\") "
Jul 18 02:31:15.338193 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.338063    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-home" (OuterVolumeSpecName: "home") pod "0895e978-211f-4a2a-b9cb-330e0d36000b" (UID: "0895e978-211f-4a2a-b9cb-330e0d36000b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:15.338193 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.338158    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-model-cache" (OuterVolumeSpecName: "model-cache") pod "0895e978-211f-4a2a-b9cb-330e0d36000b" (UID: "0895e978-211f-4a2a-b9cb-330e0d36000b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:15.338359 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.338311    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0895e978-211f-4a2a-b9cb-330e0d36000b" (UID: "0895e978-211f-4a2a-b9cb-330e0d36000b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:15.338422 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.338366    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-home\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:31:15.338422 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.338380    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-model-cache\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:31:15.340257 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.340227    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-dshm" (OuterVolumeSpecName: "dshm") pod "0895e978-211f-4a2a-b9cb-330e0d36000b" (UID: "0895e978-211f-4a2a-b9cb-330e0d36000b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:31:15.340414 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.340268    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0895e978-211f-4a2a-b9cb-330e0d36000b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0895e978-211f-4a2a-b9cb-330e0d36000b" (UID: "0895e978-211f-4a2a-b9cb-330e0d36000b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:31:15.340414 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.340348    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0895e978-211f-4a2a-b9cb-330e0d36000b-kube-api-access-6ff28" (OuterVolumeSpecName: "kube-api-access-6ff28") pod "0895e978-211f-4a2a-b9cb-330e0d36000b" (UID: "0895e978-211f-4a2a-b9cb-330e0d36000b"). InnerVolumeSpecName "kube-api-access-6ff28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:31:15.439424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.439367    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0895e978-211f-4a2a-b9cb-330e0d36000b-tls-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:31:15.439424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.439418    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-tmp-dir\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:31:15.439424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.439428    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0895e978-211f-4a2a-b9cb-330e0d36000b-dshm\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:31:15.439424 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.439438    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ff28\" (UniqueName: \"kubernetes.io/projected/0895e978-211f-4a2a-b9cb-330e0d36000b-kube-api-access-6ff28\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:31:15.517604 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.517504    2562 generic.go:356] "Generic (PLEG): container finished" podID="0895e978-211f-4a2a-b9cb-330e0d36000b" containerID="008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c" exitCode=0
Jul 18 02:31:15.517604 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.517565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg" event={"ID":"0895e978-211f-4a2a-b9cb-330e0d36000b","Type":"ContainerDied","Data":"008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c"}
Jul 18 02:31:15.517838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.517613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg" event={"ID":"0895e978-211f-4a2a-b9cb-330e0d36000b","Type":"ContainerDied","Data":"67831d606942315285893015addb8953f02921bbedb4331489a968cc40b093d8"}
Jul 18 02:31:15.517838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.517635    2562 scope.go:117] "RemoveContainer" containerID="008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c"
Jul 18 02:31:15.517838 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.517569    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"
Jul 18 02:31:15.529077 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.529054    2562 scope.go:117] "RemoveContainer" containerID="008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c"
Jul 18 02:31:15.529429 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:31:15.529404    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c\": container with ID starting with 008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c not found: ID does not exist" containerID="008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c"
Jul 18 02:31:15.529516 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.529444    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c"} err="failed to get container status \"008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c\": rpc error: code = NotFound desc = could not find container \"008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c\": container with ID starting with 008041c4058456111bf46685e1108a2f30db2523333a30c20e32124de0ee327c not found: ID does not exist"
Jul 18 02:31:15.541457 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.541423    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"]
Jul 18 02:31:15.544933 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:15.544908    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2cb736/sub-test-model-2cb736-kserve-5bc46f777-ncdhg"]
Jul 18 02:31:16.531943 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:16.531908    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0895e978-211f-4a2a-b9cb-330e0d36000b" path="/var/lib/kubelet/pods/0895e978-211f-4a2a-b9cb-330e0d36000b/volumes"
Jul 18 02:31:37.240496 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:37.240393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:31:37.341517 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:37.341472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:31:37.993650 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:37.993519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:31:46.207747 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:46.207656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:31:46.310795 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:31:46.310753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:32:12.801725 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:12.801684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:32:34.889674 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.889629    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"]
Jul 18 02:32:34.894219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.894187    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0895e978-211f-4a2a-b9cb-330e0d36000b" containerName="main"
Jul 18 02:32:34.894219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.894216    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0895e978-211f-4a2a-b9cb-330e0d36000b" containerName="main"
Jul 18 02:32:34.894456 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.894424    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0895e978-211f-4a2a-b9cb-330e0d36000b" containerName="main"
Jul 18 02:32:34.898116 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.898091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:34.898261 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.898197    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"]
Jul 18 02:32:34.900593 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.900566    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"openshift-service-ca.crt\""
Jul 18 02:32:34.901532 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.901501    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"kube-root-ca.crt\""
Jul 18 02:32:34.901670 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.901564    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"rate-test-model-16c040-kserve-self-signed-certs\""
Jul 18 02:32:34.901743 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.901671    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-16c040\"/\"default-dockercfg-drv94\""
Jul 18 02:32:34.915190 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:34.915153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:32:35.037714 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.037678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-home\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.037714 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.037717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxdv\" (UniqueName: \"kubernetes.io/projected/d99a11ac-176c-4494-b739-37c183a6292c-kube-api-access-wdxdv\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.037976 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.037849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-model-cache\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.037976 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.037879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-dshm\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.037976 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.037927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99a11ac-176c-4494-b739-37c183a6292c-tls-certs\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.037976 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.037970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-tmp-dir\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139123 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-home\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139123 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxdv\" (UniqueName: \"kubernetes.io/projected/d99a11ac-176c-4494-b739-37c183a6292c-kube-api-access-wdxdv\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-model-cache\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-dshm\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99a11ac-176c-4494-b739-37c183a6292c-tls-certs\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139437 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-tmp-dir\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139634 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-home\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139753 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-model-cache\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.139884 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.139865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-tmp-dir\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.141798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.141775    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-dshm\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.141974 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.141955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99a11ac-176c-4494-b739-37c183a6292c-tls-certs\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.147204 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.147176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxdv\" (UniqueName: \"kubernetes.io/projected/d99a11ac-176c-4494-b739-37c183a6292c-kube-api-access-wdxdv\") pod \"rate-test-model-16c040-kserve-5777c898f5-w5t5w\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") " pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.208680 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.208638    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:35.374303 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.374182    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"]
Jul 18 02:32:35.376795 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:32:35.376765    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd99a11ac_176c_4494_b739_37c183a6292c.slice/crio-efd5a8e3d46a4d8c5c4a751ad90108b21230ad7baa70d040e7cb6840066be7a7 WatchSource:0}: Error finding container efd5a8e3d46a4d8c5c4a751ad90108b21230ad7baa70d040e7cb6840066be7a7: Status 404 returned error can't find the container with id efd5a8e3d46a4d8c5c4a751ad90108b21230ad7baa70d040e7cb6840066be7a7
Jul 18 02:32:35.919146 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.919109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w" event={"ID":"d99a11ac-176c-4494-b739-37c183a6292c","Type":"ContainerStarted","Data":"64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc"}
Jul 18 02:32:35.919567 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.919161    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w" event={"ID":"d99a11ac-176c-4494-b739-37c183a6292c","Type":"ContainerStarted","Data":"efd5a8e3d46a4d8c5c4a751ad90108b21230ad7baa70d040e7cb6840066be7a7"}
Jul 18 02:32:35.937862 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:35.937808    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w" podStartSLOduration=1.937790972 podStartE2EDuration="1.937790972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:32:35.936318688 +0000 UTC m=+2663.335733889" watchObservedRunningTime="2026-07-18 02:32:35.937790972 +0000 UTC m=+2663.337190630"
Jul 18 02:32:44.422497 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:44.422461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:32:44.519977 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:44.519940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:32:45.209093 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:45.209049    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:45.209386 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:45.209363    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:45.221735 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:45.221709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:32:45.979207 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:32:45.979178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:33:21.580428 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:21.580386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:33:22.563185 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:22.563144    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"]
Jul 18 02:33:22.581797 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:22.581753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:33:37.585687 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.585645    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w" podUID="d99a11ac-176c-4494-b739-37c183a6292c" containerName="main" containerID="cri-o://64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc" gracePeriod=45
Jul 18 02:33:37.837072 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.837001    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:33:37.872472 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872434    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-home\") pod \"d99a11ac-176c-4494-b739-37c183a6292c\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") "
Jul 18 02:33:37.872472 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99a11ac-176c-4494-b739-37c183a6292c-tls-certs\") pod \"d99a11ac-176c-4494-b739-37c183a6292c\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") "
Jul 18 02:33:37.872757 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-dshm\") pod \"d99a11ac-176c-4494-b739-37c183a6292c\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") "
Jul 18 02:33:37.872757 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872563    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdxdv\" (UniqueName: \"kubernetes.io/projected/d99a11ac-176c-4494-b739-37c183a6292c-kube-api-access-wdxdv\") pod \"d99a11ac-176c-4494-b739-37c183a6292c\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") "
Jul 18 02:33:37.872757 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872613    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-tmp-dir\") pod \"d99a11ac-176c-4494-b739-37c183a6292c\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") "
Jul 18 02:33:37.872757 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872651    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-model-cache\") pod \"d99a11ac-176c-4494-b739-37c183a6292c\" (UID: \"d99a11ac-176c-4494-b739-37c183a6292c\") "
Jul 18 02:33:37.872981 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872781    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-home" (OuterVolumeSpecName: "home") pod "d99a11ac-176c-4494-b739-37c183a6292c" (UID: "d99a11ac-176c-4494-b739-37c183a6292c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:37.873045 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.872995    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d99a11ac-176c-4494-b739-37c183a6292c" (UID: "d99a11ac-176c-4494-b739-37c183a6292c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:37.873045 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.873017    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d99a11ac-176c-4494-b739-37c183a6292c" (UID: "d99a11ac-176c-4494-b739-37c183a6292c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:37.873214 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.873195    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-home\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:37.873276 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.873221    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-tmp-dir\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:37.873276 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.873236    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-model-cache\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:37.874949 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.874912    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99a11ac-176c-4494-b739-37c183a6292c-kube-api-access-wdxdv" (OuterVolumeSpecName: "kube-api-access-wdxdv") pod "d99a11ac-176c-4494-b739-37c183a6292c" (UID: "d99a11ac-176c-4494-b739-37c183a6292c"). InnerVolumeSpecName "kube-api-access-wdxdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:33:37.874949 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.874935    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99a11ac-176c-4494-b739-37c183a6292c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d99a11ac-176c-4494-b739-37c183a6292c" (UID: "d99a11ac-176c-4494-b739-37c183a6292c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:33:37.875109 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.874935    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-dshm" (OuterVolumeSpecName: "dshm") pod "d99a11ac-176c-4494-b739-37c183a6292c" (UID: "d99a11ac-176c-4494-b739-37c183a6292c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:33:37.973933 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.973892    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d99a11ac-176c-4494-b739-37c183a6292c-dshm\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:37.973933 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.973922    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdxdv\" (UniqueName: \"kubernetes.io/projected/d99a11ac-176c-4494-b739-37c183a6292c-kube-api-access-wdxdv\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:37.973933 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:37.973933    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d99a11ac-176c-4494-b739-37c183a6292c-tls-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:38.235283 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.235183    2562 generic.go:356] "Generic (PLEG): container finished" podID="d99a11ac-176c-4494-b739-37c183a6292c" containerID="64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc" exitCode=0
Jul 18 02:33:38.235283 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.235226    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"
Jul 18 02:33:38.235283 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.235257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w" event={"ID":"d99a11ac-176c-4494-b739-37c183a6292c","Type":"ContainerDied","Data":"64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc"}
Jul 18 02:33:38.235561 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.235296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w" event={"ID":"d99a11ac-176c-4494-b739-37c183a6292c","Type":"ContainerDied","Data":"efd5a8e3d46a4d8c5c4a751ad90108b21230ad7baa70d040e7cb6840066be7a7"}
Jul 18 02:33:38.235561 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.235314    2562 scope.go:117] "RemoveContainer" containerID="64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc"
Jul 18 02:33:38.254286 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.254266    2562 scope.go:117] "RemoveContainer" containerID="64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc"
Jul 18 02:33:38.254643 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:33:38.254623    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc\": container with ID starting with 64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc not found: ID does not exist" containerID="64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc"
Jul 18 02:33:38.254737 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.254650    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc"} err="failed to get container status \"64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc\": rpc error: code = NotFound desc = could not find container \"64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc\": container with ID starting with 64145330298a735960e182930d4115eeb25a57175bef060860912219cd9492fc not found: ID does not exist"
Jul 18 02:33:38.262728 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.262698    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"]
Jul 18 02:33:38.266725 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.266696    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-16c040/rate-test-model-16c040-kserve-5777c898f5-w5t5w"]
Jul 18 02:33:38.531252 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:38.531212    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99a11ac-176c-4494-b739-37c183a6292c" path="/var/lib/kubelet/pods/d99a11ac-176c-4494-b739-37c183a6292c/volumes"
Jul 18 02:33:42.003711 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:42.003654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:33:42.103668 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:42.103631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:33:51.890307 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:51.890271    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"]
Jul 18 02:33:51.890816 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:51.890548    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng" podUID="0ea2ec60-6431-43b0-863f-eeb96c54c11b" containerName="maas-api" containerID="cri-o://ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735" gracePeriod=30
Jul 18 02:33:51.912519 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:51.912487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:33:52.140694 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.140636    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:33:52.214960 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.214922    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/0ea2ec60-6431-43b0-863f-eeb96c54c11b-kube-api-access-z5964\") pod \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") "
Jul 18 02:33:52.215141 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.215076    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls\") pod \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") "
Jul 18 02:33:52.215141 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.215108    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea2ec60-6431-43b0-863f-eeb96c54c11b-openshift-service-ca\") pod \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\" (UID: \"0ea2ec60-6431-43b0-863f-eeb96c54c11b\") "
Jul 18 02:33:52.215556 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.215525    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea2ec60-6431-43b0-863f-eeb96c54c11b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ea2ec60-6431-43b0-863f-eeb96c54c11b" (UID: "0ea2ec60-6431-43b0-863f-eeb96c54c11b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:33:52.217123 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.217097    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea2ec60-6431-43b0-863f-eeb96c54c11b-kube-api-access-z5964" (OuterVolumeSpecName: "kube-api-access-z5964") pod "0ea2ec60-6431-43b0-863f-eeb96c54c11b" (UID: "0ea2ec60-6431-43b0-863f-eeb96c54c11b"). InnerVolumeSpecName "kube-api-access-z5964". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:33:52.217235 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.217105    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ea2ec60-6431-43b0-863f-eeb96c54c11b" (UID: "0ea2ec60-6431-43b0-863f-eeb96c54c11b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:33:52.309653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.309615    2562 generic.go:356] "Generic (PLEG): container finished" podID="0ea2ec60-6431-43b0-863f-eeb96c54c11b" containerID="ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735" exitCode=0
Jul 18 02:33:52.309826 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.309672    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"
Jul 18 02:33:52.309826 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.309708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng" event={"ID":"0ea2ec60-6431-43b0-863f-eeb96c54c11b","Type":"ContainerDied","Data":"ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735"}
Jul 18 02:33:52.309826 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.309764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng" event={"ID":"0ea2ec60-6431-43b0-863f-eeb96c54c11b","Type":"ContainerDied","Data":"c570c3a8a1e65bc680d03645ef87d5e2ca0263be1f805be40b3b736d421a7a07"}
Jul 18 02:33:52.309826 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.309793    2562 scope.go:117] "RemoveContainer" containerID="ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735"
Jul 18 02:33:52.316218 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.316197    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea2ec60-6431-43b0-863f-eeb96c54c11b-maas-api-tls\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:52.316218 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.316218    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea2ec60-6431-43b0-863f-eeb96c54c11b-openshift-service-ca\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:52.316389 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.316227    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/0ea2ec60-6431-43b0-863f-eeb96c54c11b-kube-api-access-z5964\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:33:52.319939 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.319923    2562 scope.go:117] "RemoveContainer" containerID="ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735"
Jul 18 02:33:52.320199 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:33:52.320183    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735\": container with ID starting with ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735 not found: ID does not exist" containerID="ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735"
Jul 18 02:33:52.320238 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.320209    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735"} err="failed to get container status \"ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735\": rpc error: code = NotFound desc = could not find container \"ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735\": container with ID starting with ed66544e3fd28403d5f56bb27b096ad57df722b3f52b87302634464960686735 not found: ID does not exist"
Jul 18 02:33:52.331456 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.331430    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"]
Jul 18 02:33:52.334934 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.334909    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-2cb736-5cd788bb6c-vxjng"]
Jul 18 02:33:52.532495 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:52.532462    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea2ec60-6431-43b0-863f-eeb96c54c11b" path="/var/lib/kubelet/pods/0ea2ec60-6431-43b0-863f-eeb96c54c11b/volumes"
Jul 18 02:33:56.468318 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:56.468274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:33:56.860391 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:33:56.860350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:02.694471 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:02.694434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:02.760999 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:02.760963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:02.943653 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:02.943609    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"]
Jul 18 02:34:02.943899 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:02.943873    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy" containerID="cri-o://e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec" gracePeriod=30
Jul 18 02:34:02.967506 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:02.967413    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:03.191821 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:03.191783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:03.912897 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:03.912860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:04.013258 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:04.013216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:06.332214 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:06.332174    2562 patch_prober.go:28] interesting pod/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:34:06.332619 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:06.332239    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:34:08.211446 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.211378    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:34:08.273580 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273544    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-envoy\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.273580 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273588    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-socket\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.273802 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273629    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-token\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.273802 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273653    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfmp8\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-kube-api-access-hfmp8\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.273802 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29294fd7-a960-462f-861b-6b2cf26ad8a5-istiod-ca-cert\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.273802 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-podinfo\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.273802 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273779    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-data\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.274053 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273819    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-credential-socket\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.274053 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273857    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-certs\") pod \"29294fd7-a960-462f-861b-6b2cf26ad8a5\" (UID: \"29294fd7-a960-462f-861b-6b2cf26ad8a5\") "
Jul 18 02:34:08.274053 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.273908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:08.274221 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.274108    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:08.274221 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.274161    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29294fd7-a960-462f-861b-6b2cf26ad8a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:34:08.274352 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.274236    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.274352 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.274250    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.274352 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.274317    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:08.274802 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.274776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:08.275921 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.275893    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:08.276388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.276357    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:34:08.276388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.276366    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:34:08.276508 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.276428    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-kube-api-access-hfmp8" (OuterVolumeSpecName: "kube-api-access-hfmp8") pod "29294fd7-a960-462f-861b-6b2cf26ad8a5" (UID: "29294fd7-a960-462f-861b-6b2cf26ad8a5"). InnerVolumeSpecName "kube-api-access-hfmp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:34:08.375402 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.375361    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29294fd7-a960-462f-861b-6b2cf26ad8a5-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.375402 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.375397    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.375402 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.375410    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.375656 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.375420    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.375656 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.375430    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.375656 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.375437    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.375656 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.375445    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfmp8\" (UniqueName: \"kubernetes.io/projected/29294fd7-a960-462f-861b-6b2cf26ad8a5-kube-api-access-hfmp8\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:08.392276 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.392231    2562 generic.go:356] "Generic (PLEG): container finished" podID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerID="e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec" exitCode=0
Jul 18 02:34:08.392483 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.392285    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"
Jul 18 02:34:08.392483 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.392305    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" event={"ID":"29294fd7-a960-462f-861b-6b2cf26ad8a5","Type":"ContainerDied","Data":"e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec"}
Jul 18 02:34:08.392483 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.392404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm" event={"ID":"29294fd7-a960-462f-861b-6b2cf26ad8a5","Type":"ContainerDied","Data":"8907660f85607eaa845d76ac78238fe117cb48a8fdce5d167861c801dc063b3a"}
Jul 18 02:34:08.392483 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.392427    2562 scope.go:117] "RemoveContainer" containerID="e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec"
Jul 18 02:34:08.402219 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.402199    2562 scope.go:117] "RemoveContainer" containerID="931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f"
Jul 18 02:34:08.410792 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.410770    2562 scope.go:117] "RemoveContainer" containerID="e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec"
Jul 18 02:34:08.411134 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:34:08.411110    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec\": container with ID starting with e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec not found: ID does not exist" containerID="e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec"
Jul 18 02:34:08.411212 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.411147    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec"} err="failed to get container status \"e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec\": rpc error: code = NotFound desc = could not find container \"e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec\": container with ID starting with e75576df38c539c1b9f4f7d3f3863fc2509e44810915f364797c574cb8f3b2ec not found: ID does not exist"
Jul 18 02:34:08.411212 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.411173    2562 scope.go:117] "RemoveContainer" containerID="931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f"
Jul 18 02:34:08.411555 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:34:08.411533    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f\": container with ID starting with 931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f not found: ID does not exist" containerID="931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f"
Jul 18 02:34:08.411610 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.411575    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f"} err="failed to get container status \"931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f\": rpc error: code = NotFound desc = could not find container \"931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f\": container with ID starting with 931df0041a5ddfb498ebdaeecd3234caa30f632f80b55e788199b960d712ee1f not found: ID does not exist"
Jul 18 02:34:08.415492 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.415463    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"]
Jul 18 02:34:08.418461 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.418436    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-2cb736-openshift-default-c49b79c4c-8r2jm"]
Jul 18 02:34:08.532445 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:08.532411    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" path="/var/lib/kubelet/pods/29294fd7-a960-462f-861b-6b2cf26ad8a5/volumes"
Jul 18 02:34:13.709652 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:13.709560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:18.387892 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:18.387851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:18.757783 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:18.757742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:24.742842 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:24.742808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:24.843265 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:24.843231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:24.989632 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:24.989600    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"]
Jul 18 02:34:24.989856 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:24.989816    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy" containerID="cri-o://ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b" gracePeriod=30
Jul 18 02:34:25.003033 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:25.003002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:25.240862 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:25.240831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:28.277035 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:28.276996    2562 patch_prober.go:28] interesting pod/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 02:34:28.277520 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:28.277059    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 02:34:30.246392 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.246361    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:34:30.394168 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-envoy\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394176    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-token\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394221    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-socket\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istiod-ca-cert\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394300    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-certs\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394388 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394373    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-podinfo\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394768 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394400    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr8mp\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-kube-api-access-wr8mp\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394768 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-credential-socket\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394768 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394529    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:30.394768 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394640    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-data\") pod \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\" (UID: \"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81\") "
Jul 18 02:34:30.394768 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394680    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:30.395033 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394767    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:34:30.395033 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.394830    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:30.395137 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.395084    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istiod-ca-cert\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.395137 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.395105    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-certs\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.395137 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.395119    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-credential-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.395137 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.395132    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-workload-socket\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.395675 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.395647    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-data" (OuterVolumeSpecName: "istio-data") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:30.396689 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.396656    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:34:30.396798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.396690    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 02:34:30.396798 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.396760    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-kube-api-access-wr8mp" (OuterVolumeSpecName: "kube-api-access-wr8mp") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "kube-api-access-wr8mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:34:30.396904 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.396823    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" (UID: "f0ed23ea-368e-4ff1-a7eb-72cb7214cc81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:34:30.496463 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.496424    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-podinfo\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.496463 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.496457    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr8mp\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-kube-api-access-wr8mp\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.496463 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.496468    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-data\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.496463 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.496476    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-envoy\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.496744 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.496484    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81-istio-token\") on node \"ip-10-0-137-80.ec2.internal\" DevicePath \"\""
Jul 18 02:34:30.512983 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.512947    2562 generic.go:356] "Generic (PLEG): container finished" podID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerID="ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b" exitCode=0
Jul 18 02:34:30.513132 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.512992    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"
Jul 18 02:34:30.513132 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.513026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" event={"ID":"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81","Type":"ContainerDied","Data":"ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b"}
Jul 18 02:34:30.513132 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.513079    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng" event={"ID":"f0ed23ea-368e-4ff1-a7eb-72cb7214cc81","Type":"ContainerDied","Data":"9becbc43dde60332af2be38f4da89a2c36ecfd7073865eb2872fd4472ab53304"}
Jul 18 02:34:30.513132 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.513102    2562 scope.go:117] "RemoveContainer" containerID="ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b"
Jul 18 02:34:30.522756 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.522734    2562 scope.go:117] "RemoveContainer" containerID="38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461"
Jul 18 02:34:30.531469 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.531447    2562 scope.go:117] "RemoveContainer" containerID="ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b"
Jul 18 02:34:30.531791 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:34:30.531762    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b\": container with ID starting with ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b not found: ID does not exist" containerID="ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b"
Jul 18 02:34:30.531908 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.531802    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b"} err="failed to get container status \"ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b\": rpc error: code = NotFound desc = could not find container \"ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b\": container with ID starting with ae383c9396348cfda0f5de7e4dd518d17f906a515bc1b736d35b4338836b5d2b not found: ID does not exist"
Jul 18 02:34:30.531908 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.531828    2562 scope.go:117] "RemoveContainer" containerID="38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461"
Jul 18 02:34:30.532585 ip-10-0-137-80 kubenswrapper[2562]: E0718 02:34:30.532558    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461\": container with ID starting with 38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461 not found: ID does not exist" containerID="38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461"
Jul 18 02:34:30.532668 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.532595    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461"} err="failed to get container status \"38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461\": rpc error: code = NotFound desc = could not find container \"38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461\": container with ID starting with 38766f9382958672ffd0ce4efb49879811218735a6c42b93070cb6f8befc9461 not found: ID does not exist"
Jul 18 02:34:30.534222 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.534201    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"]
Jul 18 02:34:30.538751 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:30.538732    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-16c040-openshift-default-588b67d9cf-jp7ng"]
Jul 18 02:34:31.568552 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:31.568523    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-4pm7q_a8bfc056-cc54-4080-a72d-2de3ddc268dc/copy-manifests/0.log"
Jul 18 02:34:31.575247 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:31.575222    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-4pm7q_a8bfc056-cc54-4080-a72d-2de3ddc268dc/manager/0.log"
Jul 18 02:34:32.401467 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:32.401433    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739015-pgctz_12c52df2-8606-4912-b65f-1db167d4e951/cleanup/0.log"
Jul 18 02:34:32.530340 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:32.530279    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" path="/var/lib/kubelet/pods/f0ed23ea-368e-4ff1-a7eb-72cb7214cc81/volumes"
Jul 18 02:34:32.621765 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:32.621734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-94kpn_d3fda4fc-5f05-46de-9e4f-2945418d5a36/postgres/0.log"
Jul 18 02:34:33.790634 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:33.790602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:33.840649 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:33.840613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:34.207777 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:34.207693    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cv8dh_026f5850-4c6f-4789-a8fe-055adbe70b27/kuadrant-console-plugin/0.log"
Jul 18 02:34:35.243365 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:35.243307    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c44dbb944-n2jcl_a5517401-298d-4bc1-8bda-ae8d0ae920eb/kube-auth-proxy/0.log"
Jul 18 02:34:36.156123 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:36.156087    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r7d7c_14de4a83-a106-42db-b9fe-50285998f3cf/main/0.log"
Jul 18 02:34:36.375927 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:36.375892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2cgv2_9e5b89a1-b810-42dd-9be5-d67541963cfb/main/0.log"
Jul 18 02:34:42.128847 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.128806    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4d8sb/must-gather-b7pkr"]
Jul 18 02:34:42.129252 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129239    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea2ec60-6431-43b0-863f-eeb96c54c11b" containerName="maas-api"
Jul 18 02:34:42.129298 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129254    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea2ec60-6431-43b0-863f-eeb96c54c11b" containerName="maas-api"
Jul 18 02:34:42.129298 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129262    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy"
Jul 18 02:34:42.129298 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129269    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy"
Jul 18 02:34:42.129298 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129277    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy"
Jul 18 02:34:42.129298 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129283    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy"
Jul 18 02:34:42.129298 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129291    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99a11ac-176c-4494-b739-37c183a6292c" containerName="main"
Jul 18 02:34:42.129298 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129299    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99a11ac-176c-4494-b739-37c183a6292c" containerName="main"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129311    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129316    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129411    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99a11ac-176c-4494-b739-37c183a6292c" containerName="main"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129420    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129428    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129434    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea2ec60-6431-43b0-863f-eeb96c54c11b" containerName="maas-api"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129440    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="29294fd7-a960-462f-861b-6b2cf26ad8a5" containerName="istio-proxy"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129508    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy"
Jul 18 02:34:42.129559 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129516    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy"
Jul 18 02:34:42.129821 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.129585    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ed23ea-368e-4ff1-a7eb-72cb7214cc81" containerName="istio-proxy"
Jul 18 02:34:42.134013 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.133993    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.136428 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.136406    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4d8sb\"/\"kube-root-ca.crt\""
Jul 18 02:34:42.137349 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.137312    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4d8sb\"/\"default-dockercfg-6ncht\""
Jul 18 02:34:42.137404 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.137312    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4d8sb\"/\"openshift-service-ca.crt\""
Jul 18 02:34:42.142694 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.142668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4d8sb/must-gather-b7pkr"]
Jul 18 02:34:42.148144 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.148107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:42.208973 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.208934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmjqf\" (UniqueName: \"kubernetes.io/projected/3f1d0999-eaef-4fac-af00-c61dbb9bd7d0-kube-api-access-dmjqf\") pod \"must-gather-b7pkr\" (UID: \"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0\") " pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.208973 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.208981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3f1d0999-eaef-4fac-af00-c61dbb9bd7d0-must-gather-output\") pod \"must-gather-b7pkr\" (UID: \"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0\") " pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.309777 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.309736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmjqf\" (UniqueName: \"kubernetes.io/projected/3f1d0999-eaef-4fac-af00-c61dbb9bd7d0-kube-api-access-dmjqf\") pod \"must-gather-b7pkr\" (UID: \"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0\") " pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.309994 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.309805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3f1d0999-eaef-4fac-af00-c61dbb9bd7d0-must-gather-output\") pod \"must-gather-b7pkr\" (UID: \"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0\") " pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.310158 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.310138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3f1d0999-eaef-4fac-af00-c61dbb9bd7d0-must-gather-output\") pod \"must-gather-b7pkr\" (UID: \"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0\") " pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.319481 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.319456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmjqf\" (UniqueName: \"kubernetes.io/projected/3f1d0999-eaef-4fac-af00-c61dbb9bd7d0-kube-api-access-dmjqf\") pod \"must-gather-b7pkr\" (UID: \"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0\") " pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.444546 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.444441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4d8sb/must-gather-b7pkr"
Jul 18 02:34:42.589717 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.589689    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4d8sb/must-gather-b7pkr"]
Jul 18 02:34:42.592230 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:34:42.592199    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f1d0999_eaef_4fac_af00_c61dbb9bd7d0.slice/crio-8329a3c93251c8842722627ebb58a4896977dba5bb2c6478ec9f39cff28e836b WatchSource:0}: Error finding container 8329a3c93251c8842722627ebb58a4896977dba5bb2c6478ec9f39cff28e836b: Status 404 returned error can't find the container with id 8329a3c93251c8842722627ebb58a4896977dba5bb2c6478ec9f39cff28e836b
Jul 18 02:34:42.594531 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:42.594512    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:34:43.576492 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:43.576391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:34:43.585301 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:43.585256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4d8sb/must-gather-b7pkr" event={"ID":"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0","Type":"ContainerStarted","Data":"d715b1aee22bb7df670e975f56ff2d7e60fe1ce63fab0147e044f7617c1ab5a1"}
Jul 18 02:34:43.585499 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:43.585316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4d8sb/must-gather-b7pkr" event={"ID":"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0","Type":"ContainerStarted","Data":"2a0c51882556c3bf61ff242e8ae83eeaaa9a27331a6ecc5576b1c72be15c7065"}
Jul 18 02:34:43.585499 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:43.585359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4d8sb/must-gather-b7pkr" event={"ID":"3f1d0999-eaef-4fac-af00-c61dbb9bd7d0","Type":"ContainerStarted","Data":"8329a3c93251c8842722627ebb58a4896977dba5bb2c6478ec9f39cff28e836b"}
Jul 18 02:34:43.602291 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:43.602194    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4d8sb/must-gather-b7pkr" podStartSLOduration=0.917583167 podStartE2EDuration="1.602170128s" totalImagesPullingTime="684.586961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:34:43.601008904 +0000 UTC m=+2791.000408567" watchObservedRunningTime="2026-07-18 02:34:43.602170128 +0000 UTC m=+2791.001569787"
Jul 18 02:34:45.006063 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:45.006026    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w4ds8_866c3e97-9799-4ba5-9028-ef73eaf3487f/global-pull-secret-syncer/0.log"
Jul 18 02:34:45.065360 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:45.065300    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log"
Jul 18 02:34:45.180090 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:45.180057    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-80.ec2.internal_1b3df1fc75eded3f7d78936d4b1afba9/haproxy/0.log"
Jul 18 02:34:50.466020 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:50.465951    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cv8dh_026f5850-4c6f-4789-a8fe-055adbe70b27/kuadrant-console-plugin/0.log"
Jul 18 02:34:52.846025 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:52.845979    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6/alertmanager/0.log"
Jul 18 02:34:52.931029 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:52.930991    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6/config-reloader/0.log"
Jul 18 02:34:52.974722 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:52.974621    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6/kube-rbac-proxy-web/0.log"
Jul 18 02:34:53.001836 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.001788    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6/kube-rbac-proxy/0.log"
Jul 18 02:34:53.024985 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.024914    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6/kube-rbac-proxy-metric/0.log"
Jul 18 02:34:53.048693 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.048660    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6/prom-label-proxy/0.log"
Jul 18 02:34:53.073693 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.073661    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3287c97-4dc9-46e8-ad9f-6e894cd4b8b6/init-config-reloader/0.log"
Jul 18 02:34:53.168592 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.168557    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-42xxg_62a7bf56-c0c4-4712-afed-de5da6ada7be/kube-state-metrics/0.log"
Jul 18 02:34:53.185468 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.185434    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-42xxg_62a7bf56-c0c4-4712-afed-de5da6ada7be/kube-rbac-proxy-main/0.log"
Jul 18 02:34:53.246922 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.246840    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-42xxg_62a7bf56-c0c4-4712-afed-de5da6ada7be/kube-rbac-proxy-self/0.log"
Jul 18 02:34:53.556160 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.556124    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9zsb_6adc182a-5682-46e7-a076-82eaf81021be/node-exporter/0.log"
Jul 18 02:34:53.575545 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.575500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9zsb_6adc182a-5682-46e7-a076-82eaf81021be/kube-rbac-proxy/0.log"
Jul 18 02:34:53.596292 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.596260    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9zsb_6adc182a-5682-46e7-a076-82eaf81021be/init-textfile/0.log"
Jul 18 02:34:53.622758 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.622724    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-dwcp4_158e6022-101e-42b1-8620-3c94f45ce302/kube-rbac-proxy-main/0.log"
Jul 18 02:34:53.647429 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.647399    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-dwcp4_158e6022-101e-42b1-8620-3c94f45ce302/kube-rbac-proxy-self/0.log"
Jul 18 02:34:53.678208 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.678184    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-dwcp4_158e6022-101e-42b1-8620-3c94f45ce302/openshift-state-metrics/0.log"
Jul 18 02:34:53.726942 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.726907    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a964985-149a-484b-8ec1-b0996f32fac1/prometheus/0.log"
Jul 18 02:34:53.751938 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.751898    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a964985-149a-484b-8ec1-b0996f32fac1/config-reloader/0.log"
Jul 18 02:34:53.775706 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.775672    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a964985-149a-484b-8ec1-b0996f32fac1/thanos-sidecar/0.log"
Jul 18 02:34:53.798695 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.798658    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a964985-149a-484b-8ec1-b0996f32fac1/kube-rbac-proxy-web/0.log"
Jul 18 02:34:53.819455 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.819369    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a964985-149a-484b-8ec1-b0996f32fac1/kube-rbac-proxy/0.log"
Jul 18 02:34:53.839943 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.839860    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a964985-149a-484b-8ec1-b0996f32fac1/kube-rbac-proxy-thanos/0.log"
Jul 18 02:34:53.862347 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.862304    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5a964985-149a-484b-8ec1-b0996f32fac1/init-config-reloader/0.log"
Jul 18 02:34:53.892346 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.891556    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tq97x_296a69b7-1957-4b88-9ef0-05f114a29e46/prometheus-operator/0.log"
Jul 18 02:34:53.918785 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.918756    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tq97x_296a69b7-1957-4b88-9ef0-05f114a29e46/kube-rbac-proxy/0.log"
Jul 18 02:34:53.968336 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.968259    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-654c8fbc6c-7vdnz_caef0234-857e-4bb3-8391-f2e002872b8d/telemeter-client/0.log"
Jul 18 02:34:53.990073 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:53.990029    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-654c8fbc6c-7vdnz_caef0234-857e-4bb3-8391-f2e002872b8d/reload/0.log"
Jul 18 02:34:54.011187 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:54.011159    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-654c8fbc6c-7vdnz_caef0234-857e-4bb3-8391-f2e002872b8d/kube-rbac-proxy/0.log"
Jul 18 02:34:54.044988 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:54.044955    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b49687679-98bxp_ec85967c-e020-4b7f-98f3-6d4cddb7d918/thanos-query/0.log"
Jul 18 02:34:54.065814 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:54.065784    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b49687679-98bxp_ec85967c-e020-4b7f-98f3-6d4cddb7d918/kube-rbac-proxy-web/0.log"
Jul 18 02:34:54.087676 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:54.087590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b49687679-98bxp_ec85967c-e020-4b7f-98f3-6d4cddb7d918/kube-rbac-proxy/0.log"
Jul 18 02:34:54.109059 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:54.109030    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b49687679-98bxp_ec85967c-e020-4b7f-98f3-6d4cddb7d918/prom-label-proxy/0.log"
Jul 18 02:34:54.129065 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:54.129036    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b49687679-98bxp_ec85967c-e020-4b7f-98f3-6d4cddb7d918/kube-rbac-proxy-rules/0.log"
Jul 18 02:34:54.157425 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:54.157395    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b49687679-98bxp_ec85967c-e020-4b7f-98f3-6d4cddb7d918/kube-rbac-proxy-metrics/0.log"
Jul 18 02:34:55.841151 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.841111    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"]
Jul 18 02:34:55.846912 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.846886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:55.855279 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.855244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"]
Jul 18 02:34:55.982354 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.982305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvcml\" (UniqueName: \"kubernetes.io/projected/0ccdbb85-d858-4e5d-aba8-32e493855794-kube-api-access-jvcml\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:55.982556 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.982378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-podres\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:55.982556 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.982541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-sys\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:55.982681 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.982560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-proc\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:55.982681 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:55.982588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-lib-modules\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083589 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-sys\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083589 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-proc\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083837 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-lib-modules\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083837 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-sys\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083837 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvcml\" (UniqueName: \"kubernetes.io/projected/0ccdbb85-d858-4e5d-aba8-32e493855794-kube-api-access-jvcml\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083837 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-podres\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083982 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083799    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-proc\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083982 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-lib-modules\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.083982 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.083876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ccdbb85-d858-4e5d-aba8-32e493855794-podres\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.094871 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.094780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvcml\" (UniqueName: \"kubernetes.io/projected/0ccdbb85-d858-4e5d-aba8-32e493855794-kube-api-access-jvcml\") pod \"perf-node-gather-daemonset-z4224\" (UID: \"0ccdbb85-d858-4e5d-aba8-32e493855794\") " pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.161614 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.161582    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.351260 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.350101    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"]
Jul 18 02:34:56.353520 ip-10-0-137-80 kubenswrapper[2562]: W0718 02:34:56.353479    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ccdbb85_d858_4e5d_aba8_32e493855794.slice/crio-603999dadf5c0e5c995a29a782e04584ece267b375b00e3ad51725c11487af0e WatchSource:0}: Error finding container 603999dadf5c0e5c995a29a782e04584ece267b375b00e3ad51725c11487af0e: Status 404 returned error can't find the container with id 603999dadf5c0e5c995a29a782e04584ece267b375b00e3ad51725c11487af0e
Jul 18 02:34:56.499028 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.499003    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-547c96dc77-cf5j9_8e222d88-1b7a-4bb7-badf-5ac9f92fbdd3/console/0.log"
Jul 18 02:34:56.681852 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.681746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224" event={"ID":"0ccdbb85-d858-4e5d-aba8-32e493855794","Type":"ContainerStarted","Data":"13d454e2ef6c6901ecdf5c0bcd31ffa2987b134d17bf65e6fb67983ed29e4594"}
Jul 18 02:34:56.682008 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.681928    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:34:56.682008 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.681976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224" event={"ID":"0ccdbb85-d858-4e5d-aba8-32e493855794","Type":"ContainerStarted","Data":"603999dadf5c0e5c995a29a782e04584ece267b375b00e3ad51725c11487af0e"}
Jul 18 02:34:56.697580 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:56.697524    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224" podStartSLOduration=1.697506974 podStartE2EDuration="1.697506974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:34:56.695965489 +0000 UTC m=+2804.095365198" watchObservedRunningTime="2026-07-18 02:34:56.697506974 +0000 UTC m=+2804.096906633"
Jul 18 02:34:58.202934 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:58.202894    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8zcg_19099886-e214-4a73-be60-0db2bbaff0bf/dns/0.log"
Jul 18 02:34:58.221952 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:58.221916    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8zcg_19099886-e214-4a73-be60-0db2bbaff0bf/kube-rbac-proxy/0.log"
Jul 18 02:34:58.290636 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:58.290608    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vz7zd_2d55b449-511a-4a2c-b30f-335a75a6641c/dns-node-resolver/0.log"
Jul 18 02:34:58.863253 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:58.863222    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6vlch_28a93625-af19-433a-bc86-3783cd839f50/node-ca/0.log"
Jul 18 02:34:59.953722 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:34:59.953689    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c44dbb944-n2jcl_a5517401-298d-4bc1-8bda-ae8d0ae920eb/kube-auth-proxy/0.log"
Jul 18 02:35:00.890623 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:00.890590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vv6p6_8e1b824e-d8dd-4822-8faa-ce068ec8e33d/serve-healthcheck-canary/0.log"
Jul 18 02:35:01.439397 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:01.439369    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hj6j4_02e2456a-ebdf-4a99-b7a3-54bc1847458e/kube-rbac-proxy/0.log"
Jul 18 02:35:01.459205 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:01.459176    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hj6j4_02e2456a-ebdf-4a99-b7a3-54bc1847458e/exporter/0.log"
Jul 18 02:35:01.479663 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:01.479624    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hj6j4_02e2456a-ebdf-4a99-b7a3-54bc1847458e/extractor/0.log"
Jul 18 02:35:02.699029 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:02.698998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4d8sb/perf-node-gather-daemonset-z4224"
Jul 18 02:35:04.332816 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:04.332776    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-4pm7q_a8bfc056-cc54-4080-a72d-2de3ddc268dc/manager/0.log"
Jul 18 02:35:04.353442 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:04.353417    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6667d74d96-4pm7q_a8bfc056-cc54-4080-a72d-2de3ddc268dc/copy-manifests/0.log"
Jul 18 02:35:05.995030 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:05.994997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b6fc5d786-4smw6_3328d2b6-eb57-4990-b775-0a22a093e841/manager/0.log"
Jul 18 02:35:06.045163 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:06.045124    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4wgqv_aa0a7e9f-380f-41c6-b8e0-8eb510645abc/openshift-lws-operator/0.log"
Jul 18 02:35:06.624879 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:06.624837    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c44dbb944-n2jcl_a5517401-298d-4bc1-8bda-ae8d0ae920eb/kube-auth-proxy/0.log"
Jul 18 02:35:08.101145 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:08.101067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c44dbb944-n2jcl_a5517401-298d-4bc1-8bda-ae8d0ae920eb/kube-auth-proxy/0.log"
Jul 18 02:35:12.254676 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.254641    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dxcv_df167a9d-85cf-4536-884a-7b0152aaf711/kube-multus-additional-cni-plugins/0.log"
Jul 18 02:35:12.275265 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.275235    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dxcv_df167a9d-85cf-4536-884a-7b0152aaf711/egress-router-binary-copy/0.log"
Jul 18 02:35:12.294897 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.294867    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dxcv_df167a9d-85cf-4536-884a-7b0152aaf711/cni-plugins/0.log"
Jul 18 02:35:12.315342 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.315308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dxcv_df167a9d-85cf-4536-884a-7b0152aaf711/bond-cni-plugin/0.log"
Jul 18 02:35:12.336660 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.336632    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dxcv_df167a9d-85cf-4536-884a-7b0152aaf711/routeoverride-cni/0.log"
Jul 18 02:35:12.356917 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.356890    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dxcv_df167a9d-85cf-4536-884a-7b0152aaf711/whereabouts-cni-bincopy/0.log"
Jul 18 02:35:12.375909 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.375877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dxcv_df167a9d-85cf-4536-884a-7b0152aaf711/whereabouts-cni/0.log"
Jul 18 02:35:12.711385 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.711258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jbq87_69d8d9d5-f280-4c42-aed5-411e051b5691/kube-multus/0.log"
Jul 18 02:35:12.793999 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.793964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:35:12.855258 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.855207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-knml9_f7695c40-95bf-4ba2-a4e5-efe1e67e7ca6/konnectivity-agent/0.log" limit=1024
Jul 18 02:35:12.896093 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.896061    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wqbsh_c38452c4-ccde-4d4d-8e80-49821f53736e/network-metrics-daemon/0.log"
Jul 18 02:35:12.913931 ip-10-0-137-80 kubenswrapper[2562]: I0718 02:35:12.913903    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wqbsh_c38452c4-ccde-4d4d-8e80-49821f53736e/kube-rbac-proxy/0.log"