Nov 02 13:40:26.765289 ip-10-0-131-166 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 02 13:40:26.765308 ip-10-0-131-166 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 02 13:40:26.765319 ip-10-0-131-166 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 02 13:40:26.765713 ip-10-0-131-166 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 02 13:40:36.995756 ip-10-0-131-166 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 02 13:40:36.995776 ip-10-0-131-166 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dd4141fca2724ed7bb70f54d782e759f --
Nov 02 13:42:27.123203 ip-10-0-131-166 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 13:42:27.556706 ip-10-0-131-166 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 13:42:27.556706 ip-10-0-131-166 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 13:42:27.556706 ip-10-0-131-166 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 13:42:27.556706 ip-10-0-131-166 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561651    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561801    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561805    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561809    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561812    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561815    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561817    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561820    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561823    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561825    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.561811 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561828    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561831    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561834    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561837    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561839    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561842    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561844    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561847    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561850    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561852    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561854    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561872    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561875    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561878    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561881    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561884    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561888    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561891    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561893    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561896    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.562231 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561907    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561911    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561913    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561915    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561918    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561921    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561923    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561926    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561929    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561932    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561934    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561937    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561940    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561942    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561947    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561952    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561955    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561959    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.562701 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561963    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561966    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561969    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561972    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561974    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561977    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561980    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561982    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561985    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561987    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561990    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561992    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561995    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.561999    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562002    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562004    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562007    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562010    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562012    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.563150 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562015    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562017    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562020    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562022    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562025    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562027    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562030    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562033    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562035    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562039    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562042    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562045    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562047    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562050    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562053    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562056    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562067    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562070    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562074    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.563639 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562077    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562079    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562082    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562085    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562087    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562090    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562093    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562095    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562098    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562101    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562103    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562106    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562109    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562111    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562114    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562117    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562119    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562122    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562124    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.564115 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.562128    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.564995 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.564977    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.564995 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.564994    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.564998    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565001    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565003    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565006    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565009    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565012    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565014    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565017    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565021    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565023    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565027    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565030    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565032    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565035    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565038    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565040    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565043    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565046    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565048    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.565054 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565051    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565054    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565056    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565059    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565062    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565065    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565068    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565071    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565073    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565076    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565078    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565081    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565083    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565086    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565089    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565091    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565094    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565096    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565099    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565101    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.565560 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565104    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565106    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565109    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565112    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565114    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565117    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565119    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565122    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565124    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565126    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565129    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565131    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565134    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565136    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565143    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565146    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565148    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565151    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565154    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.566055 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565156    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565158    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565161    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565163    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565166    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565168    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565171    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565174    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565177    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565179    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565181    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565184    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565186    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565189    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565191    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565193    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565197    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565201    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565205    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.566605 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565209    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565212    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565215    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565218    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565220    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565223    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565225    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565228    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565232    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565234    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565237    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565240    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565242    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565245    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565247    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565251    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565255    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565257    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565260    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.567101 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565263    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565265    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565268    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565270    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565273    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565275    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565278    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565282    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565835    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565842    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565852    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565857    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565877    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565882    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565885    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565888    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565891    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565894    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565896    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.567558 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565900    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565903    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565906    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565909    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565912    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565914    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565917    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565920    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565922    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565925    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565927    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565930    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565932    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565935    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565937    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565940    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565942    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565944    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565947    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565949    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.568026 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565952    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565954    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565956    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565959    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565962    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565965    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565968    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565972    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565975    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565978    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565980    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565982    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565985    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565987    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565990    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565992    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565995    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.565997    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566000    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566002    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.568504 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566005    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566007    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566010    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566013    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566015    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566018    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566020    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566023    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566025    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566028    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566030    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566041    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566044    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566047    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566049    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566052    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566055    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566065    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566070    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566074    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.569001 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566076    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566079    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566082    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566084    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566087    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566090    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566092    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566095    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566098    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566100    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566103    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566105    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566107    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566110    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566113    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566116    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566118    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566121    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566123    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.569477 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566126    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566128    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566131    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566133    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566135    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566138    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566142    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566146    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566149    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566152    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566155    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566158    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566161    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566163    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566166    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.566168    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567136    2576 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567154    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567163    2576 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567168    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 13:42:27.569942 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567173    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567177    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567181    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567188    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567191    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567194    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567198    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567202    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567206    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567209    2576 flags.go:64] FLAG: --cgroup-root=""
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567212    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567215    2576 flags.go:64] FLAG: --client-ca-file=""
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567219    2576 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567222    2576 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567227    2576 flags.go:64] FLAG: --cluster-domain=""
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567230    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567234    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567237    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567241    2576 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567252    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567256    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567262    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567265    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567268    2576 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 13:42:27.570420 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567275    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567278    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567281    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567284    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567289    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567292    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567295    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567298    2576 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567302    2576 flags.go:64] FLAG: --enable-server="true"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567305    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567310    2576 flags.go:64] FLAG: --event-burst="100"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567313    2576 flags.go:64] FLAG: --event-qps="50"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567316    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567319    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567322    2576 flags.go:64] FLAG: --eviction-hard=""
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567327    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567331    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567335    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567338    2576 flags.go:64] FLAG: --eviction-soft=""
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567341    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567344    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567347    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567350    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567353    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567356    2576 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 13:42:27.571041 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567359    2576 flags.go:64] FLAG: --feature-gates=""
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567363    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567366    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567369    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567375    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567378    2576 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567381    2576 flags.go:64] FLAG: --help="false"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567384    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567389    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567392    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567395    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567399    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567402    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567405    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567408    2576 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567411    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567414    2576 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567417    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567420    2576 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567423    2576 flags.go:64] FLAG: --kube-reserved=""
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567426    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567429    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567432    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 13:42:27.571693 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567435    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567438    2576 flags.go:64] FLAG: --lock-file=""
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567441    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567444    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567447    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567453    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567456    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567459    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567463    2576 flags.go:64] FLAG: --logging-format="text"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567465    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567469    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567472    2576 flags.go:64] FLAG: --manifest-url=""
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567475    2576 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567486    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567489    2576 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567493    2576 flags.go:64] FLAG: --max-pods="110"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567497    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567500    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567504    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567507    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567510    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567513    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567516    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567525    2576 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567528    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 13:42:27.572266 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567531    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567534    2576 flags.go:64] FLAG: --pod-cidr=""
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567537    2576 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567540    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567543    2576 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567546    2576 flags.go:64] FLAG: --port="10250"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567549    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567552    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0b560661d78d7360c"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567555    2576 flags.go:64] FLAG: --qos-reserved=""
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567558    2576 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567561    2576 flags.go:64] FLAG: --register-node="true"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567564    2576 flags.go:64] FLAG: --register-with-taints=""
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567568    2576 flags.go:64] FLAG: --registry-burst="10"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567571    2576 flags.go:64] FLAG: --registry-qps="5"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567574    2576 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567577    2576 flags.go:64] FLAG: --reserved-memory=""
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567581    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567584    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567587    2576 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567590    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567594    2576 flags.go:64] FLAG: --runonce="false"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567597    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567600    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567603    2576 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567606    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567609    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 13:42:27.572882 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567613    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567617    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567620    2576 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567623    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567626    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567629    2576 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567632    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567635    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567638    2576 flags.go:64] FLAG: --system-cgroups=""
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567641    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567646    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567649    2576 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567652    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567657    2576 flags.go:64] FLAG: --tls-min-version=""
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567660    2576 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567663    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567666    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567669    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567672    2576 flags.go:64] FLAG: --v="2"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567677    2576 flags.go:64] FLAG: --version="false"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567682    2576 flags.go:64] FLAG: --vmodule=""
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567686    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.567689    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567841    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.573552 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567846    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567848    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567853    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567856    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567872    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567875    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567878    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567881    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567883    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567887    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567890    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567892    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567895    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567898    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567901    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567903    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567906    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567908    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567911    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567914    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.574136 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567916    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567919    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567922    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567924    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567927    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567929    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567932    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567934    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567937    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567939    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567942    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567944    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567947    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567949    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567953    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567956    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567958    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567961    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567963    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567966    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.574668 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567968    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567971    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567974    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567977    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567979    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567984    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567987    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567989    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567992    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567994    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.567998    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568001    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568004    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568006    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568009    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568011    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568014    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568018    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568021    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.575169 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568024    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568027    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568029    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568032    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568035    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568037    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568040    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568044    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568046    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568049    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568051    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568054    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568056    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568059    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568061    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568064    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568067    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568070    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568074    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.575654 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568076    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568079    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568081    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568084    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568086    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568089    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568091    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568094    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568097    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568099    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568102    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568104    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568106    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568109    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568111    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568114    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568116    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568119    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568121    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568124    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.576220 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568128    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568130    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568133    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568136    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568140    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568143    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568147    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.568175    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568215    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568220    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568224    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568228    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568231    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568234    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568236    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.576691 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568239    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568242    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568244    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568247    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568249    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568252    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568255    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568257    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568260    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568262    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568265    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568267    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568270    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568272    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568275    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568277    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568280    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568282    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568286    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568289    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.577177 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568292    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568294    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568297    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568299    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568302    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568304    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568306    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568309    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568314    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568317    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568320    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568322    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568325    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568327    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568330    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568332    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568336    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568339    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568342    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.577660 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568345    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568348    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568350    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568353    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568355    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568358    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568360    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568363    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568365    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568367    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568370    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568374    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568376    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568379    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568381    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568384    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568387    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568390    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568392    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568394    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.578139 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568397    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568403    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568414    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568417    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568420    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568422    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568425    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568427    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568430    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568433    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568435    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568438    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568440    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568443    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568446    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568448    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568451    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568453    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568456    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568458    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.578631 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568460    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568463    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568465    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568469    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568472    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568475    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568477    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568480    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568482    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568484    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568487    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568490    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568492    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568497    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568499    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568503    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568506    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568509    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568513    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.579114 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.568517    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.576154    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.576175    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.576193    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.576199    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576261    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576267    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576271    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576273    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576276    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576279    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576281    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576284    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576287    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576290    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576292    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576295    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576298    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576300    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.579568 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576303    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576305    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576308    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576310    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576313    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576316    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576319    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576322    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576325    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576328    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576331    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576333    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576336    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576338    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576341    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576344    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576347    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576350    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576352    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576355    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.580127 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576357    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576360    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576364    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576368    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576371    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576375    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576378    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576381    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576383    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576385    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576388    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576390    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576393    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576395    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576398    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576400    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576403    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576405    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576408    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576410    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.580644 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576412    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576415    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576418    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576422    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576426    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576430    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576434    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576438    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576441    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576444    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576447    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576450    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576453    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576455    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576458    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576460    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576463    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576465    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576468    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.581152 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576471    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576473    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576476    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576479    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576481    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576484    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576486    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576489    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576491    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576493    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576496    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576498    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576501    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576504    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576506    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576509    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576513    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576515    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576518    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.581664 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576521    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576524    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576526    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576529    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576531    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576534    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576537    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576539    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576541    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576544    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576546    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576549    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576551    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576554    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.576583    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576737    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.582228 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576743    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576746    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576749    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576752    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576755    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576758    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576761    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576763    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576766    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576768    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576771    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576774    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576777    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576779    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576783    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576785    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576788    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576790    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576794    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.582610 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576799    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576802    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576805    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576807    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576810    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576813    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576815    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576818    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576820    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576823    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576825    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576828    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576830    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576833    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576835    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576837    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576840    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576842    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576845    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576847    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.583124 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576850    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576852    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576854    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576857    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576875    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576877    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576880    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576882    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576885    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576889    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576892    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576894    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576897    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576900    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576903    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576906    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576909    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576912    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576914    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.583590 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576917    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576919    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576922    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576924    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576927    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576930    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576932    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576935    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576938    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576940    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576943    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576945    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576948    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576950    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576953    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576955    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576958    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576961    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576964    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576966    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.584155 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576969    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576971    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576974    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576977    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576980    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576982    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576985    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576987    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576990    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576992    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576995    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576997    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.576999    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577002    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577004    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577007    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577009    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577011    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577014    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577017    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.584803 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577019    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577022    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577024    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577026    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577029    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577031    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577034    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.577057    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577094    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577098    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577101    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577104    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577106    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577110    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577112    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577116    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:42:27.585700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577119    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577122    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577124    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577126    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577129    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577132    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577134    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577140    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577143    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577145    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577148    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577151    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577153    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577156    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577159    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577161    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577164    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577167    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577169    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577172    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:42:27.586385 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577174    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577178    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577180    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577183    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577186    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577189    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577192    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577194    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577197    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577200    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577202    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577205    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577208    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577211    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577214    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577216    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577219    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577221    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577224    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:42:27.586956 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577228    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577230    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577233    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577236    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577238    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577241    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577243    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577246    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577248    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577250    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577253    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577255    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577258    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577261    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577264    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577266    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577270    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577273    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577276    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:42:27.587411 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577280    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577283    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577286    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577288    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577291    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577293    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577296    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577299    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577301    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577304    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577306    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577308    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577311    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577315    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577317    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577320    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577322    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577325    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577327    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577330    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:42:27.587980 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577333    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577335    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577338    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577340    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577343    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577345    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577347    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577350    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577352    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577357    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577360    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577362    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577365    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577367    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577370    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577375    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577379    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577382    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577384    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:42:27.588617 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:27.577387    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:42:27.589119 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.577444    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 13:42:27.589119 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.579942    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 02 13:42:27.589119 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.581007    2576 server.go:1014] "Starting client certificate rotation"
Nov 02 13:42:27.589119 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.581125    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 13:42:27.589119 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.581949    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 13:42:27.589119 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.583387    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 13:42:27.589538 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.589518    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 13:42:27.604511 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.604483    2576 log.go:25] "Validated CRI v1 runtime API"
Nov 02 13:42:27.607775 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.607754    2576 log.go:25] "Validated CRI v1 image API"
Nov 02 13:42:27.608746 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.608719    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 13:42:27.612500 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.612432    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ccef5dfc-40a6-4a75-9d3e-49d06b75bef3:/dev/nvme0n1p4 f1d26b2f-efd7-4500-9539-cec1b960506d:/dev/nvme0n1p3]
Nov 02 13:42:27.612500 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.612473    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 02 13:42:27.618132 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.617984    2576 manager.go:217] Machine: {Timestamp:2026-11-02 13:42:27.616478879 +0000 UTC m=+0.374952774 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091333 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd37fa2ebf5920203c5ddbd6ba32b SystemUUID:ec2dd37f-a2eb-f592-0203-c5ddbd6ba32b BootID:dd4141fc-a272-4ed7-bb70-f54d782e759f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c5:da:27:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c5:da:27:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:c0:12:7e:94:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 13:42:27.618132 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.618129    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 13:42:27.618247 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.618230    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 13:42:27.619245 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.619229    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 13:42:27.621138 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.621106    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 13:42:27.621303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.621143    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-166.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 13:42:27.621349 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.621307    2576 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 13:42:27.621349 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.621315    2576 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 13:42:27.621401 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.621350    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 13:42:27.621401 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.621370    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 13:42:27.622604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.622590    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 13:42:27.627243 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627226    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 13:42:27.627404 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627395    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 13:42:27.627462 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627454    2576 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 13:42:27.627491 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627468    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 13:42:27.627491 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627481    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 13:42:27.627571 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627492    2576 kubelet.go:405] "Adding apiserver pod source"
Nov 02 13:42:27.627571 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627500    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 13:42:27.627943 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.627930    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 13:42:27.631109 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.631085    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 13:42:27.639118 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.639032    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 13:42:27.640605 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640577    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 13:42:27.640713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640636    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 13:42:27.640936 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640921    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 13:42:27.640981 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640949    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 13:42:27.640981 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640960    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 13:42:27.640981 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640970    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 13:42:27.640981 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640979    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 13:42:27.641088 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.640988    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 13:42:27.641615 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.641605    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 13:42:27.641647 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.641616    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 13:42:27.641647 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.641625    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 13:42:27.641647 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.641631    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 13:42:27.641647 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.641640    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 13:42:27.641838 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.641649    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 13:42:27.642433 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.642421    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 13:42:27.642481 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.642435    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 13:42:27.642555 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.642535    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp5jt"
Nov 02 13:42:27.646775 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.646753    2576 server.go:1263] "Started kubelet"
Nov 02 13:42:27.646910 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.646856    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 13:42:27.647488 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.647411    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 13:42:27.647570 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.647516    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 13:42:27.648275 ip-10-0-131-166 systemd[1]: Started Kubernetes Kubelet.
Nov 02 13:42:27.649100 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.648989    2576 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 13:42:27.649220 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.649131    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 13:42:27.654277 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.654254    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 02 13:42:27.656203 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.656182    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 13:42:27.656814 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.656792    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wp5jt"
Nov 02 13:42:27.656940 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.656805    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 13:42:27.657047 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.657029    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:27.657597 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.657559    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-166.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 02 13:42:27.657670 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.657653    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 13:42:27.657729 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.657673    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 13:42:27.657777 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.657653    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 13:42:27.657835 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.657811    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-166.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 02 13:42:27.657913 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.657789    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 02 13:42:27.657913 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.657841    2576 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 13:42:27.657913 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.657852    2576 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 13:42:27.658781 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.657603    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-166.us-east-2.compute.internal.18e43e34b20ce870  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-166.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-166.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 13:42:27.64671192 +0000 UTC m=+0.405185815,LastTimestamp:2026-11-02 13:42:27.64671192 +0000 UTC m=+0.405185815,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-166.us-east-2.compute.internal,}"
Nov 02 13:42:27.659198 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.659176    2576 factory.go:153] Registering CRI-O factory
Nov 02 13:42:27.659198 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.659199    2576 factory.go:223] Registration of the crio container factory successfully
Nov 02 13:42:27.659346 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.659273    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 13:42:27.659346 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.659294    2576 factory.go:55] Registering systemd factory
Nov 02 13:42:27.659346 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.659302    2576 factory.go:223] Registration of the systemd container factory successfully
Nov 02 13:42:27.659346 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.659317    2576 factory.go:103] Registering Raw factory
Nov 02 13:42:27.659346 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.659330    2576 manager.go:1199] Started watching for new ooms in manager
Nov 02 13:42:27.660739 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.660433    2576 manager.go:319] Starting recovery of all containers
Nov 02 13:42:27.663893 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.662997    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-166.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 02 13:42:27.673237 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.673210    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:42:27.673602 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.673582    2576 manager.go:324] Recovery completed
Nov 02 13:42:27.678088 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.678071    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:42:27.680006 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.679985    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:42:27.680103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.680022    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:42:27.680103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.680036    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:42:27.680656 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.680645    2576 cpu_manager.go:226] "Starting" policy="none"
Nov 02 13:42:27.680656 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.680655    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 13:42:27.680720 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.680657    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:42:27.680720 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.680672    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 13:42:27.681384 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.681365    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:42:27.681477 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.681400    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:42:27.681477 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.681411    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:42:27.682810 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.682796    2576 policy_none.go:50] "Start"
Nov 02 13:42:27.682846 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.682814    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 13:42:27.682846 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.682828    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 13:42:27.684983 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.684965    2576 policy_none.go:44] "Start"
Nov 02 13:42:27.718878 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.718653    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 13:42:27.723139 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.723110    2576 manager.go:341] "Starting Device Plugin manager"
Nov 02 13:42:27.723296 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.723152    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 13:42:27.723296 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.723166    2576 server.go:87] "Starting device plugin registration server"
Nov 02 13:42:27.723485 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.723472    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 13:42:27.723552 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.723485    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 13:42:27.723602 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.723589    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 13:42:27.723708 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.723694    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 13:42:27.723708 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.723706    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 13:42:27.724336 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.724303    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 13:42:27.724443 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.724366    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:27.792781 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.792744    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 13:42:27.794893 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.794132    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 13:42:27.794893 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.794172    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 13:42:27.794893 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.794196    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 13:42:27.794893 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.794240    2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 02 13:42:27.798530 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.798501    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:42:27.823645 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.823568    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:42:27.824617 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.824596    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:42:27.824705 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.824640    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:42:27.824705 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.824656    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:42:27.824705 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.824683    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.834392 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.834369    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.834456 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.834399    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-166.us-east-2.compute.internal\": node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:27.848302 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.848279    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:27.894407 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.894346    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"]
Nov 02 13:42:27.894620 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.894458    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:42:27.895814 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.895792    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:42:27.895954 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.895829    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:42:27.895954 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.895846    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:42:27.898511 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.898474    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:42:27.898710 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.898688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.898761 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.898747    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:42:27.899736 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.899708    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:42:27.899891 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.899749    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:42:27.899891 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.899760    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:42:27.899891 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.899773    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:42:27.899891 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.899772    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:42:27.900049 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.899930    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:42:27.902344 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.902327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.902403 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.902361    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:42:27.903262 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.903241    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:42:27.903346 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.903285    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:42:27.903346 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.903316    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:42:27.931747 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.931725    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found" node="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.935303 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.935277    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found" node="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.949121 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:27.949088    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:27.959713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.959682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d5883c7dbe396f1be7fa323b910e645-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"8d5883c7dbe396f1be7fa323b910e645\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.959788 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.959717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:27.959788 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:27.959744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.049409 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:28.049367    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:28.060852 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.060820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d5883c7dbe396f1be7fa323b910e645-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"8d5883c7dbe396f1be7fa323b910e645\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.061002 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.060880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.061002 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.060929    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.061002 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.060934    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d5883c7dbe396f1be7fa323b910e645-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"8d5883c7dbe396f1be7fa323b910e645\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.061002 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.060964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.061002 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.060987    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.150305 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:28.150278    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:28.234950 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.234915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.238211 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.238182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.250381 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:28.250350    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:28.350996 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:28.350954    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:28.451555 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:28.451472    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:28.552141 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:28.552094    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:28.580676 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.580646    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 02 13:42:28.581163 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.580816    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 13:42:28.581163 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.580839    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 02 13:42:28.652248 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:28.652204    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:42:28.663608 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.663550    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 13:37:28 +0000 UTC" deadline="2028-08-11 22:01:15.393173518 +0000 UTC"
Nov 02 13:42:28.663608 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.663599    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15560h18m46.729576419s"
Nov 02 13:42:28.698550 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.698520    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:42:28.757976 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.757893    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.769149 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.769121    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 13:42:28.770828 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.770802    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:42:28.784175 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.784137    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 13:42:28.890975 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:28.890943    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c54cde61181c8e33c72b5d5e568694e.slice/crio-47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4 WatchSource:0}: Error finding container 47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4: Status 404 returned error can't find the container with id 47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4
Nov 02 13:42:28.893193 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:28.893160    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5883c7dbe396f1be7fa323b910e645.slice/crio-471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6 WatchSource:0}: Error finding container 471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6: Status 404 returned error can't find the container with id 471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6
Nov 02 13:42:28.895714 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:28.895683    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 13:42:30.412100 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.412044    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:42:30.786019 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.785983    2576 apiserver.go:52] "Watching apiserver"
Nov 02 13:42:30.794776 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.794737    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 13:42:30.795232 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.795204    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pwcd7","openshift-ovn-kubernetes/ovnkube-node-zpx7n","openshift-cluster-node-tuning-operator/tuned-cwfjf","openshift-dns/node-resolver-w8cmr","openshift-multus/multus-8jmp5","openshift-multus/network-metrics-daemon-6xr2g","openshift-network-diagnostics/network-check-target-zkqr7","kube-system/global-pull-secret-syncer-2lgfl","kube-system/konnectivity-agent-h7znv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv","openshift-image-registry/node-ca-q5f2p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-nh9mh"]
Nov 02 13:42:30.798055 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.798030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.800157 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.800135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:30.800282 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.800222    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:30.804985 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.804962    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fbcvm\""
Nov 02 13:42:30.805111 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.805098    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 13:42:30.805154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.805136    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 13:42:30.805307 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.805289    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:30.805362 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.805319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.805412 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.805377    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:30.807220 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.806816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.811233 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.810367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.812962 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.812938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.813990 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.813967    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 02 13:42:30.816259 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.816235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.816387 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.816304    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:30.820124 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.820095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:30.823629 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.823581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.826336 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-sys\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.826336 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-netd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.826553 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cnibin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826553 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-socket-dir-parent\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826553 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-netns\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826553 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lx2\" (UniqueName: \"kubernetes.io/projected/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-kube-api-access-t6lx2\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826553 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysconfig\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.826553 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-kubernetes\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqctg\" (UniqueName: \"kubernetes.io/projected/3cc4a08b-8598-4bc2-851e-8bbd2854245b-kube-api-access-tqctg\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-systemd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b84bd6d-f423-4226-81b7-ce29872a76a8-iptables-alerter-script\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4qs\" (UniqueName: \"kubernetes.io/projected/00b1feca-1c57-49db-a7a1-effee069ca7d-kube-api-access-pl4qs\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-kubelet\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-ovn\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-system-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-conf\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-slash\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-k8s-cni-cncf-io\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-multus\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-kubelet\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.826972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-tmp-dir\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.826984    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-tuned\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-netns\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-bin\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxkz9\" (UniqueName: \"kubernetes.io/projected/7b84bd6d-f423-4226-81b7-ce29872a76a8-kube-api-access-gxkz9\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-lib-modules\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-node-log\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-log-socket\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-kubelet-config\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-env-overrides\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-dbus\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-systemd\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-config\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-hostroot\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-conf-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.827654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-daemon-config\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-etc-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-script-lib\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b84bd6d-f423-4226-81b7-ce29872a76a8-host-slash\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-run\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-host\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pjnm\" (UniqueName: \"kubernetes.io/projected/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-kube-api-access-2pjnm\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.827968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-systemd-units\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t7mc\" (UniqueName: \"kubernetes.io/projected/df7f1d80-b01d-4626-ac19-b055f34313f3-kube-api-access-2t7mc\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-hosts-file\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-multus-certs\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df7f1d80-b01d-4626-ac19-b055f34313f3-ovn-node-metrics-cert\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cni-binary-copy\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.828303 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-bin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-modprobe-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-etc-kubernetes\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-var-lib-kubelet\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-tmp\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-var-lib-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.829103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.828891    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 02 13:42:30.829512 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.829414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:30.832167 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.831785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.862212 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.862180    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8j6vr"
Nov 02 13:42:30.874797 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.874769    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8j6vr"
Nov 02 13:42:30.903407 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903371    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 13:42:30.903604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903451    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 13:42:30.903604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903481    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 13:42:30.903604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903371    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 13:42:30.903604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903371    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 13:42:30.903604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903386    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 13:42:30.903604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903521    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 13:42:30.903604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903584    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 13:42:30.903937 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903804    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cmphd\""
Nov 02 13:42:30.903937 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.903819    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 13:42:30.904933 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.904909    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 13:42:30.905086 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.904942    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 13:42:30.905086 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.904952    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tb7ws\""
Nov 02 13:42:30.905086 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.904996    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 13:42:30.905086 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.905019    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 13:42:30.905086 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.905026    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 13:42:30.905482 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.905464    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rzz2\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906381    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906381    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906400    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906404    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906444    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906455    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906462    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-mlv7f\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906472    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cjbpx\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906480    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906485    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906501    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 13:42:30.906520 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906517    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 13:42:30.907142 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906544    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 13:42:30.907142 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.906560    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cfdrs\""
Nov 02 13:42:30.907734 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.907640    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s2t6n\""
Nov 02 13:42:30.907734 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.907692    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-n56j5\""
Nov 02 13:42:30.915971 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.915940    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 13:42:30.929054 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-conf\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-slash\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-k8s-cni-cncf-io\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-multus\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-kubelet\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-device-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-tmp-dir\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-tuned\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-netns\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-bin\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929322 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929303    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-conf\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929392    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-slash\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929447    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929486    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-k8s-cni-cncf-io\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929523    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-multus\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929561    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-kubelet\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxkz9\" (UniqueName: \"kubernetes.io/projected/7b84bd6d-f423-4226-81b7-ce29872a76a8-kube-api-access-gxkz9\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-tmp-dir\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpgxw\" (UniqueName: \"kubernetes.io/projected/8b1bb6b7-76a7-4770-949d-3a93833e2553-kube-api-access-cpgxw\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-system-cni-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-lib-modules\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-node-log\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-log-socket\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-kubelet-config\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.929840 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-env-overrides\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-dbus\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929875    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-socket-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-cnibin\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929962    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-systemd\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.929989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-config\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-hostroot\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-conf-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-daemon-config\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-netns\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-etc-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-bin\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-script-lib\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930200    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.930562 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b84bd6d-f423-4226-81b7-ce29872a76a8-host-slash\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930343    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b84bd6d-f423-4226-81b7-ce29872a76a8-host-slash\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930342    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-systemd\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930648    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-conf-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-hostroot\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930721    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-node-log\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930727    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-lib-modules\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930749    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-log-socket\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.930896    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-dbus\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931046    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-config\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931150    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-env-overrides\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.931217 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931203    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-kubelet-config\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-run\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-host\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjnm\" (UniqueName: \"kubernetes.io/projected/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-kube-api-access-2pjnm\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931354    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-etc-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-systemd-units\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t7mc\" (UniqueName: \"kubernetes.io/projected/df7f1d80-b01d-4626-ac19-b055f34313f3-kube-api-access-2t7mc\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931483    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-run\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.931735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.931505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.932556    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-daemon-config\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.932694    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.932786    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs podName:3cc4a08b-8598-4bc2-851e-8bbd2854245b nodeName:}" failed. No retries permitted until 2026-11-02 13:42:31.432764841 +0000 UTC m=+3.034032859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs") pod "network-metrics-daemon-6xr2g" (UID: "3cc4a08b-8598-4bc2-851e-8bbd2854245b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.932956    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-host\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.933038    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-script-lib\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.933099    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-hosts-file\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.933169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-hosts-file\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.933673 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.933529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-multus-certs\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.934228 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.933782    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-multus-certs\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.934228 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.934199    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-systemd-units\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.935979 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.934414    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-tuned\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.936637 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.936608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df7f1d80-b01d-4626-ac19-b055f34313f3-ovn-node-metrics-cert\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.936738 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.936661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cni-binary-copy\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.937307 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-bin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.937428 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.937428 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.937428 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-modprobe-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.937428 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.937636 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:30.937636 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-etc-kubernetes\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.937636 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-var-lib-kubelet\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.937636 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-tmp\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.937636 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-var-lib-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.937636 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-registration-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.937807 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hcq\" (UniqueName: \"kubernetes.io/projected/f6993051-07c5-4982-ae6f-862d23237028-kube-api-access-49hcq\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:30.937807 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937769    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cni-binary-copy\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.937883 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-sys\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.937955 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-sys-fs\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:30.937995 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-netd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.937995 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.937982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cnibin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938080 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938046    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-var-lib-kubelet\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.938135 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938060    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cnibin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938135 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-socket-dir-parent\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938237 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938188    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-netd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.938237 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-netns\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938237 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938201    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938237 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938219    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-var-lib-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.938237 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-sys\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.938413 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lx2\" (UniqueName: \"kubernetes.io/projected/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-kube-api-access-t6lx2\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938413 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938265    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-netns\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938413 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938294    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-etc-kubernetes\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938413 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjqmx\" (UniqueName: \"kubernetes.io/projected/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-kube-api-access-zjqmx\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:30.938413 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938347    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-bin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938413 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.938371    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:30.938413 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938402    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-socket-dir-parent\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938444    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysconfig\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-kubernetes\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938546    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-modprobe-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqctg\" (UniqueName: \"kubernetes.io/projected/3cc4a08b-8598-4bc2-851e-8bbd2854245b-kube-api-access-tqctg\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.938611    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret podName:0aacf513-c851-4576-8689-d08f3c0c0ccb nodeName:}" failed. No retries permitted until 2026-11-02 13:42:31.438588559 +0000 UTC m=+3.039856564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret") pod "global-pull-secret-syncer-2lgfl" (UID: "0aacf513-c851-4576-8689-d08f3c0c0ccb") : object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938637    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysconfig\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-systemd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.938735 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938656    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-kubernetes\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b84bd6d-f423-4226-81b7-ce29872a76a8-iptables-alerter-script\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-host\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938908    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-systemd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.938981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-serviceca\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59195bdc-66bf-4fe0-80a2-5f3a55add215-agent-certs\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59195bdc-66bf-4fe0-80a2-5f3a55add215-konnectivity-ca\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4qs\" (UniqueName: \"kubernetes.io/projected/00b1feca-1c57-49db-a7a1-effee069ca7d-kube-api-access-pl4qs\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-kubelet\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-kubelet\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.939314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-ovn\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.939798 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939557    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-ovn\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.939798 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.939568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b84bd6d-f423-4226-81b7-ce29872a76a8-iptables-alerter-script\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.940216 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.940188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-system-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.941003 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.940358    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-system-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.941003 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.940789    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df7f1d80-b01d-4626-ac19-b055f34313f3-ovn-node-metrics-cert\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.941003 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.940975    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-tmp\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.943220 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.943040    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 13:42:30.943220 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.943087    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 13:42:30.943220 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.943102    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzcvk for pod openshift-network-diagnostics/network-check-target-zkqr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:30.943220 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:30.943179    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk podName:2dae05df-4c95-47be-895b-f711cc6119f4 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:31.44315932 +0000 UTC m=+3.044427336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kzcvk" (UniqueName: "kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk") pod "network-check-target-zkqr7" (UID: "2dae05df-4c95-47be-895b-f711cc6119f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:30.943875 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.943797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxkz9\" (UniqueName: \"kubernetes.io/projected/7b84bd6d-f423-4226-81b7-ce29872a76a8-kube-api-access-gxkz9\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:30.946978 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.946945    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjnm\" (UniqueName: \"kubernetes.io/projected/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-kube-api-access-2pjnm\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:30.947419 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.947401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t7mc\" (UniqueName: \"kubernetes.io/projected/df7f1d80-b01d-4626-ac19-b055f34313f3-kube-api-access-2t7mc\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:30.952037 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.952000    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lx2\" (UniqueName: \"kubernetes.io/projected/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-kube-api-access-t6lx2\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:30.952174 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.952115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqctg\" (UniqueName: \"kubernetes.io/projected/3cc4a08b-8598-4bc2-851e-8bbd2854245b-kube-api-access-tqctg\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:30.953658 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.953632    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4qs\" (UniqueName: \"kubernetes.io/projected/00b1feca-1c57-49db-a7a1-effee069ca7d-kube-api-access-pl4qs\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:30.957998 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.957944    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"0c54cde61181c8e33c72b5d5e568694e","Type":"ContainerStarted","Data":"47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4"}
Nov 02 13:42:30.959383 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:30.959322    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"8d5883c7dbe396f1be7fa323b910e645","Type":"ContainerStarted","Data":"471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6"}
Nov 02 13:42:31.027387 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.027350    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:42:31.040568 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.040568 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.040568 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.040832 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-registration-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.040832 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49hcq\" (UniqueName: \"kubernetes.io/projected/f6993051-07c5-4982-ae6f-862d23237028-kube-api-access-49hcq\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.040832 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-sys-fs\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.040832 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040694    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-sys-fs\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.040832 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-registration-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.040832 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040816    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqmx\" (UniqueName: \"kubernetes.io/projected/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-kube-api-access-zjqmx\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-host\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-serviceca\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59195bdc-66bf-4fe0-80a2-5f3a55add215-agent-certs\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59195bdc-66bf-4fe0-80a2-5f3a55add215-konnectivity-ca\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.040994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-device-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpgxw\" (UniqueName: \"kubernetes.io/projected/8b1bb6b7-76a7-4770-949d-3a93833e2553-kube-api-access-cpgxw\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-system-cni-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041145    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041156    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-host\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:31.041154 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-socket-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-cnibin\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041266    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-socket-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-serviceca\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041503    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-cnibin\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041503    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041537    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-system-cni-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.041778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.041549    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-device-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.042548 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.042525    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59195bdc-66bf-4fe0-80a2-5f3a55add215-konnectivity-ca\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:31.042548 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.042539    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.042938 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.042916    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.043785 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.043760    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59195bdc-66bf-4fe0-80a2-5f3a55add215-agent-certs\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:31.057506 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.057472    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hcq\" (UniqueName: \"kubernetes.io/projected/f6993051-07c5-4982-ae6f-862d23237028-kube-api-access-49hcq\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.057781 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.057752    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqmx\" (UniqueName: \"kubernetes.io/projected/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-kube-api-access-zjqmx\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:31.058380 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.058321    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpgxw\" (UniqueName: \"kubernetes.io/projected/8b1bb6b7-76a7-4770-949d-3a93833e2553-kube-api-access-cpgxw\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.116140 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.116094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:42:31.125578 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.125537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:42:31.128731 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.128701    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b1feca_1c57_49db_a7a1_effee069ca7d.slice/crio-c270cdc3e57870213669d0a1ef219d56aa2db63fec120d341210b63b894f889d WatchSource:0}: Error finding container c270cdc3e57870213669d0a1ef219d56aa2db63fec120d341210b63b894f889d: Status 404 returned error can't find the container with id c270cdc3e57870213669d0a1ef219d56aa2db63fec120d341210b63b894f889d
Nov 02 13:42:31.134707 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.134683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8jmp5"
Nov 02 13:42:31.136602 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.136569    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09da1ecb_8aa1_4c64_aaa6_af5b9d9d46ba.slice/crio-aeeace9c93ba989d31e1ed72f7947820022666112771a2364881f78d24a57bab WatchSource:0}: Error finding container aeeace9c93ba989d31e1ed72f7947820022666112771a2364881f78d24a57bab: Status 404 returned error can't find the container with id aeeace9c93ba989d31e1ed72f7947820022666112771a2364881f78d24a57bab
Nov 02 13:42:31.146714 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.146667    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddfdae8_aa30_4e31_b3f9_2e614f5b3cef.slice/crio-4e0939553574a999931985f50b51cd574d9d0a1bede7727c9f4a2eddf280ced9 WatchSource:0}: Error finding container 4e0939553574a999931985f50b51cd574d9d0a1bede7727c9f4a2eddf280ced9: Status 404 returned error can't find the container with id 4e0939553574a999931985f50b51cd574d9d0a1bede7727c9f4a2eddf280ced9
Nov 02 13:42:31.162131 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.162060    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:31.165638 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.165606    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:42:31.175961 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.175411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:31.175961 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.175828    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7f1d80_b01d_4626_ac19_b055f34313f3.slice/crio-6359b8027d2fe29c9aa613844035cc2596e00aec94829b9a85dcf08868b53d67 WatchSource:0}: Error finding container 6359b8027d2fe29c9aa613844035cc2596e00aec94829b9a85dcf08868b53d67: Status 404 returned error can't find the container with id 6359b8027d2fe29c9aa613844035cc2596e00aec94829b9a85dcf08868b53d67
Nov 02 13:42:31.177829 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.177809    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:42:31.180613 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.179503    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b84bd6d_f423_4226_81b7_ce29872a76a8.slice/crio-ff9b38baae1cdf93df8356d27f0f7859626e753d3773225f283ef852ce10f82c WatchSource:0}: Error finding container ff9b38baae1cdf93df8356d27f0f7859626e753d3773225f283ef852ce10f82c: Status 404 returned error can't find the container with id ff9b38baae1cdf93df8356d27f0f7859626e753d3773225f283ef852ce10f82c
Nov 02 13:42:31.185338 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.185314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:42:31.187157 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.187124    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59195bdc_66bf_4fe0_80a2_5f3a55add215.slice/crio-d3e0419bc6a598e5f04be3e9aee8b04692c177f8f10b2dfb0c5ec45cdc799409 WatchSource:0}: Error finding container d3e0419bc6a598e5f04be3e9aee8b04692c177f8f10b2dfb0c5ec45cdc799409: Status 404 returned error can't find the container with id d3e0419bc6a598e5f04be3e9aee8b04692c177f8f10b2dfb0c5ec45cdc799409
Nov 02 13:42:31.187956 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.187939    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:42:31.191249 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.191158    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6993051_07c5_4982_ae6f_862d23237028.slice/crio-a64946fc354103dfc123152485bc8f028f8b80cc641a213b450b0f004503d11a WatchSource:0}: Error finding container a64946fc354103dfc123152485bc8f028f8b80cc641a213b450b0f004503d11a: Status 404 returned error can't find the container with id a64946fc354103dfc123152485bc8f028f8b80cc641a213b450b0f004503d11a
Nov 02 13:42:31.200700 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.200665    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1bb6b7_76a7_4770_949d_3a93833e2553.slice/crio-b49e146a5733fcde46d194549c7e5c50f3c86ef0a609782d236580ac2cf9185e WatchSource:0}: Error finding container b49e146a5733fcde46d194549c7e5c50f3c86ef0a609782d236580ac2cf9185e: Status 404 returned error can't find the container with id b49e146a5733fcde46d194549c7e5c50f3c86ef0a609782d236580ac2cf9185e
Nov 02 13:42:31.204519 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:42:31.204489    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cbc0ac_084e_4ded_81bf_51bc0ebdf74c.slice/crio-52422085088b1e897d3ce14b93c14759d33d28713fc22f1a4ecb58b814133719 WatchSource:0}: Error finding container 52422085088b1e897d3ce14b93c14759d33d28713fc22f1a4ecb58b814133719: Status 404 returned error can't find the container with id 52422085088b1e897d3ce14b93c14759d33d28713fc22f1a4ecb58b814133719
Nov 02 13:42:31.215377 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.215350    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:42:31.444306 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.444227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:31.444306 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.444282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.444317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444378    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444400    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444413    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzcvk for pod openshift-network-diagnostics/network-check-target-zkqr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444427    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444469    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk podName:2dae05df-4c95-47be-895b-f711cc6119f4 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:32.444451545 +0000 UTC m=+4.045719538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzcvk" (UniqueName: "kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk") pod "network-check-target-zkqr7" (UID: "2dae05df-4c95-47be-895b-f711cc6119f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444496    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs podName:3cc4a08b-8598-4bc2-851e-8bbd2854245b nodeName:}" failed. No retries permitted until 2026-11-02 13:42:32.444477235 +0000 UTC m=+4.045745240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs") pod "network-metrics-daemon-6xr2g" (UID: "3cc4a08b-8598-4bc2-851e-8bbd2854245b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:31.444515 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444433    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:31.444858 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.444549    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret podName:0aacf513-c851-4576-8689-d08f3c0c0ccb nodeName:}" failed. No retries permitted until 2026-11-02 13:42:32.444536867 +0000 UTC m=+4.045804873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret") pod "global-pull-secret-syncer-2lgfl" (UID: "0aacf513-c851-4576-8689-d08f3c0c0ccb") : object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:31.878751 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.878464    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 13:37:30 +0000 UTC" deadline="2028-04-29 04:21:03.832664665 +0000 UTC"
Nov 02 13:42:31.878751 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.878502    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13046h38m31.954167474s"
Nov 02 13:42:31.951868 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.951841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:31.952137 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:31.952060    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:31.975479 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.975442    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerStarted","Data":"a64946fc354103dfc123152485bc8f028f8b80cc641a213b450b0f004503d11a"}
Nov 02 13:42:31.982935 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.982885    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h7znv" event={"ID":"59195bdc-66bf-4fe0-80a2-5f3a55add215","Type":"ContainerStarted","Data":"d3e0419bc6a598e5f04be3e9aee8b04692c177f8f10b2dfb0c5ec45cdc799409"}
Nov 02 13:42:31.986479 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.986441    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8jmp5" event={"ID":"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef","Type":"ContainerStarted","Data":"4e0939553574a999931985f50b51cd574d9d0a1bede7727c9f4a2eddf280ced9"}
Nov 02 13:42:31.988900 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.988819    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q5f2p" event={"ID":"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c","Type":"ContainerStarted","Data":"52422085088b1e897d3ce14b93c14759d33d28713fc22f1a4ecb58b814133719"}
Nov 02 13:42:31.990444 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.990356    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv" event={"ID":"8b1bb6b7-76a7-4770-949d-3a93833e2553","Type":"ContainerStarted","Data":"b49e146a5733fcde46d194549c7e5c50f3c86ef0a609782d236580ac2cf9185e"}
Nov 02 13:42:31.992388 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.992238    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwcd7" event={"ID":"7b84bd6d-f423-4226-81b7-ce29872a76a8","Type":"ContainerStarted","Data":"ff9b38baae1cdf93df8356d27f0f7859626e753d3773225f283ef852ce10f82c"}
Nov 02 13:42:31.998013 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:31.997970    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"6359b8027d2fe29c9aa613844035cc2596e00aec94829b9a85dcf08868b53d67"}
Nov 02 13:42:32.000211 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.000034    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w8cmr" event={"ID":"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba","Type":"ContainerStarted","Data":"aeeace9c93ba989d31e1ed72f7947820022666112771a2364881f78d24a57bab"}
Nov 02 13:42:32.003368 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.003336    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwfjf" event={"ID":"00b1feca-1c57-49db-a7a1-effee069ca7d","Type":"ContainerStarted","Data":"c270cdc3e57870213669d0a1ef219d56aa2db63fec120d341210b63b894f889d"}
Nov 02 13:42:32.051571 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.050890    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal" podStartSLOduration=3.050868298 podStartE2EDuration="3.050868298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:32.025926718 +0000 UTC m=+3.627194733" watchObservedRunningTime="2026-11-02 13:42:32.050868298 +0000 UTC m=+3.652136315"
Nov 02 13:42:32.451689 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.451645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:32.451885 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.451701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:32.451885 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.451730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:32.451885 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.451874    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:32.452097 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.451954    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret podName:0aacf513-c851-4576-8689-d08f3c0c0ccb nodeName:}" failed. No retries permitted until 2026-11-02 13:42:34.451934823 +0000 UTC m=+6.053202832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret") pod "global-pull-secret-syncer-2lgfl" (UID: "0aacf513-c851-4576-8689-d08f3c0c0ccb") : object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:32.452445 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.452423    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 13:42:32.452535 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.452449    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 13:42:32.452535 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.452462    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzcvk for pod openshift-network-diagnostics/network-check-target-zkqr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:32.452535 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.452507    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk podName:2dae05df-4c95-47be-895b-f711cc6119f4 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:34.452491775 +0000 UTC m=+6.053759768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzcvk" (UniqueName: "kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk") pod "network-check-target-zkqr7" (UID: "2dae05df-4c95-47be-895b-f711cc6119f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:32.452720 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.452584    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:32.452720 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.452620    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs podName:3cc4a08b-8598-4bc2-851e-8bbd2854245b nodeName:}" failed. No retries permitted until 2026-11-02 13:42:34.452607907 +0000 UTC m=+6.053875913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs") pod "network-metrics-daemon-6xr2g" (UID: "3cc4a08b-8598-4bc2-851e-8bbd2854245b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:32.878962 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.878894    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 13:37:30 +0000 UTC" deadline="2028-05-02 23:32:24.392831105 +0000 UTC"
Nov 02 13:42:32.878962 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.878960    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13137h49m51.513875655s"
Nov 02 13:42:32.954212 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.954179    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:32.954389 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.954303    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:32.954649 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:32.954632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:32.954760 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:32.954741    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:33.058336 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:33.058296    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"8d5883c7dbe396f1be7fa323b910e645","Type":"ContainerStarted","Data":"69175b7f9ec55d70deba819e61aaad5565f2bb526498b486384e58e174b27e1a"}
Nov 02 13:42:33.063397 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:33.062613    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c54cde61181c8e33c72b5d5e568694e" containerID="f463526aae57f0098dc4dc410682920dec6f31c5ad7403dfb00519d6fc3962b0" exitCode=0
Nov 02 13:42:33.063397 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:33.062669    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"0c54cde61181c8e33c72b5d5e568694e","Type":"ContainerDied","Data":"f463526aae57f0098dc4dc410682920dec6f31c5ad7403dfb00519d6fc3962b0"}
Nov 02 13:42:33.952371 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:33.952331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:33.952853 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:33.952485    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:34.072427 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:34.072384    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"0c54cde61181c8e33c72b5d5e568694e","Type":"ContainerStarted","Data":"b3478115c01a0ac9aef95fa354632ba92e8b7538722c30c9f8a1911be490b66e"}
Nov 02 13:42:34.469928 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:34.469888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:34.469939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:34.469966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470113    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470173    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret podName:0aacf513-c851-4576-8689-d08f3c0c0ccb nodeName:}" failed. No retries permitted until 2026-11-02 13:42:38.470156174 +0000 UTC m=+10.071424167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret") pod "global-pull-secret-syncer-2lgfl" (UID: "0aacf513-c851-4576-8689-d08f3c0c0ccb") : object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470462    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470503    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs podName:3cc4a08b-8598-4bc2-851e-8bbd2854245b nodeName:}" failed. No retries permitted until 2026-11-02 13:42:38.470491185 +0000 UTC m=+10.071759194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs") pod "network-metrics-daemon-6xr2g" (UID: "3cc4a08b-8598-4bc2-851e-8bbd2854245b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470570    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470585    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 13:42:34.470605 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470597    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzcvk for pod openshift-network-diagnostics/network-check-target-zkqr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:34.471243 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.470624    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk podName:2dae05df-4c95-47be-895b-f711cc6119f4 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:38.470616289 +0000 UTC m=+10.071884296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzcvk" (UniqueName: "kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk") pod "network-check-target-zkqr7" (UID: "2dae05df-4c95-47be-895b-f711cc6119f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:34.959965 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:34.958306    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:34.959965 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.958500    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:34.959965 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:34.959648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:34.959965 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:34.959848    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:35.080035 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:35.079990    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="1a349b1af12d26d43fc2533f87db65d687ca9d1ce58bf37ac4b56d475ed8e0e8" exitCode=0
Nov 02 13:42:35.080286 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:35.080054    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerDied","Data":"1a349b1af12d26d43fc2533f87db65d687ca9d1ce58bf37ac4b56d475ed8e0e8"}
Nov 02 13:42:35.107951 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:35.107875    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal" podStartSLOduration=6.107854826 podStartE2EDuration="6.107854826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:34.093829347 +0000 UTC m=+5.695097362" watchObservedRunningTime="2026-11-02 13:42:35.107854826 +0000 UTC m=+6.709122907"
Nov 02 13:42:35.952484 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:35.952445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:35.952822 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:35.952588    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:36.086822 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:36.086096    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h7znv" event={"ID":"59195bdc-66bf-4fe0-80a2-5f3a55add215","Type":"ContainerStarted","Data":"612a44a347d9841d76439733083a2549d3151f362d7890a63f0dcda7caef39f5"}
Nov 02 13:42:36.953317 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:36.952779    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:36.953317 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:36.952779    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:36.953317 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:36.952920    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:36.953317 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:36.952974    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:37.095446 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:37.095401    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q5f2p" event={"ID":"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c","Type":"ContainerStarted","Data":"a1576301a77b8b3bc69f6cf84fbe8dd6a06d8bcb61db4e08f56fc9666e5faa53"}
Nov 02 13:42:37.102517 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:37.102431    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv" event={"ID":"8b1bb6b7-76a7-4770-949d-3a93833e2553","Type":"ContainerStarted","Data":"70012b953fb94095533861980dca5325ab5475a9098ac7c6011028c15391d063"}
Nov 02 13:42:37.112450 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:37.112382    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q5f2p" podStartSLOduration=3.171804624 podStartE2EDuration="8.112362311s" totalImagesPullingTime="4.940557687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:37.112168991 +0000 UTC m=+8.713437006" watchObservedRunningTime="2026-11-02 13:42:37.112362311 +0000 UTC m=+8.713630326"
Nov 02 13:42:37.113399 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:37.113361    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h7znv" podStartSLOduration=4.131685333 podStartE2EDuration="8.113346404s" totalImagesPullingTime="3.981661071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:36.105537992 +0000 UTC m=+7.706806005" watchObservedRunningTime="2026-11-02 13:42:37.113346404 +0000 UTC m=+8.714614624"
Nov 02 13:42:37.648137 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:37.648104    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:37.648655 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:37.648637    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:37.952240 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:37.952200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:37.952415 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:37.952345    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:38.504966 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.504917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:38.505524 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.504982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:38.505524 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.505021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:38.505524 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505192    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:38.505524 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505260    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret podName:0aacf513-c851-4576-8689-d08f3c0c0ccb nodeName:}" failed. No retries permitted until 2026-11-02 13:42:46.505241105 +0000 UTC m=+18.106509117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret") pod "global-pull-secret-syncer-2lgfl" (UID: "0aacf513-c851-4576-8689-d08f3c0c0ccb") : object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:38.505733 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505686    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 13:42:38.505733 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505700    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 13:42:38.505733 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505714    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzcvk for pod openshift-network-diagnostics/network-check-target-zkqr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:38.505868 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505751    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk podName:2dae05df-4c95-47be-895b-f711cc6119f4 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:46.505740366 +0000 UTC m=+18.107008358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzcvk" (UniqueName: "kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk") pod "network-check-target-zkqr7" (UID: "2dae05df-4c95-47be-895b-f711cc6119f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:38.505868 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505803    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:38.505868 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.505839    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs podName:3cc4a08b-8598-4bc2-851e-8bbd2854245b nodeName:}" failed. No retries permitted until 2026-11-02 13:42:46.505827574 +0000 UTC m=+18.107095569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs") pod "network-metrics-daemon-6xr2g" (UID: "3cc4a08b-8598-4bc2-851e-8bbd2854245b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:38.633407 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.633373    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:38.634096 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.634053    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:42:38.954600 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.954567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:38.956219 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.954877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:38.956470 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.956441    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:38.957060 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:38.956676    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:38.994928 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:38.994856    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 13:42:39.112291 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:39.112136    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv" event={"ID":"8b1bb6b7-76a7-4770-949d-3a93833e2553","Type":"ContainerStarted","Data":"5c91ec537ff54d8dec5a8d2f5193a6fd6784ce6991634ebbdb0084fbfc691936"}
Nov 02 13:42:39.886545 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:39.886426    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T13:42:38.994879413Z","UUID":"72a008c7-f838-4802-bcb9-72b37375d721","Handler":null,"Name":"","Endpoint":""}
Nov 02 13:42:39.888295 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:39.888246    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 13:42:39.888295 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:39.888272    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 13:42:39.952387 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:39.952294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:39.952549 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:39.952477    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:40.116336 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.116297    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w8cmr" event={"ID":"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba","Type":"ContainerStarted","Data":"ab7909eda3328fb761f74c37ced512ed90e184888382e10353ce7d9cb9193345"}
Nov 02 13:42:40.118911 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.118866    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="45fd9b80ceef0980e05c6fef4734c2d41809aaabb6c1bdb96cbf52caaa6755a3" exitCode=0
Nov 02 13:42:40.119112 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.118963    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerDied","Data":"45fd9b80ceef0980e05c6fef4734c2d41809aaabb6c1bdb96cbf52caaa6755a3"}
Nov 02 13:42:40.121100 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.121047    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8jmp5" event={"ID":"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef","Type":"ContainerStarted","Data":"7ee51ad18496a9085703550079b84d1332298b84e7ecd3701de902f7037102da"}
Nov 02 13:42:40.165001 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.164756    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-w8cmr" podStartSLOduration=2.9582315059999997 podStartE2EDuration="11.164740649s" totalImagesPullingTime="8.206509143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:40.138158514 +0000 UTC m=+11.739426529" watchObservedRunningTime="2026-11-02 13:42:40.164740649 +0000 UTC m=+11.766008662"
Nov 02 13:42:40.185430 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.185365    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-8jmp5" podStartSLOduration=3.134974541 podStartE2EDuration="11.185346161s" totalImagesPullingTime="8.05037162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:40.185121449 +0000 UTC m=+11.786389466" watchObservedRunningTime="2026-11-02 13:42:40.185346161 +0000 UTC m=+11.786614177"
Nov 02 13:42:40.952745 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.952225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:40.952745 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:40.952376    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:40.952745 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:40.952426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:40.952745 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:40.952546    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:41.125611 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:41.125523    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="8869ca5720f0b13de2ec1101e0f938e38ff1afd9b1d4fddddc29dfd50c0ab057" exitCode=0
Nov 02 13:42:41.125781 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:41.125622    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerDied","Data":"8869ca5720f0b13de2ec1101e0f938e38ff1afd9b1d4fddddc29dfd50c0ab057"}
Nov 02 13:42:41.128231 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:41.128179    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv" event={"ID":"8b1bb6b7-76a7-4770-949d-3a93833e2553","Type":"ContainerStarted","Data":"c9fdef9b9b92d01ecbf40483461744e903f53a7d5e27f7b46dea963a57fb90ca"}
Nov 02 13:42:41.174249 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:41.174182    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv" podStartSLOduration=3.733164807 podStartE2EDuration="12.17414812s" totalImagesPullingTime="8.440983313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:41.17383223 +0000 UTC m=+12.775100244" watchObservedRunningTime="2026-11-02 13:42:41.17414812 +0000 UTC m=+12.775416136"
Nov 02 13:42:41.951992 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:41.951952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:41.952259 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:41.952108    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:42.133357 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.133317    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="82ac5c4667717a89f6b271d45e30bff8e6814346d1192f106fae2d2c668b72b3" exitCode=0
Nov 02 13:42:42.134012 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.133394    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerDied","Data":"82ac5c4667717a89f6b271d45e30bff8e6814346d1192f106fae2d2c668b72b3"}
Nov 02 13:42:42.135401 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.135323    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwcd7" event={"ID":"7b84bd6d-f423-4226-81b7-ce29872a76a8","Type":"ContainerStarted","Data":"05b02c5a9b4ad06fec38c0317b423c1db5ed96189261d4ded65c2b5a407d6bf6"}
Nov 02 13:42:42.136880 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.136851    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwfjf" event={"ID":"00b1feca-1c57-49db-a7a1-effee069ca7d","Type":"ContainerStarted","Data":"dd7f6376bf29a3c38e33db7a8b8f874f232e35f0c4dadc779be5fe5297439d1a"}
Nov 02 13:42:42.185045 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.184990    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cwfjf" podStartSLOduration=3.793698439 podStartE2EDuration="14.184972428s" totalImagesPullingTime="10.391273989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:42.184448279 +0000 UTC m=+13.785716293" watchObservedRunningTime="2026-11-02 13:42:42.184972428 +0000 UTC m=+13.786240443"
Nov 02 13:42:42.201859 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.201802    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pwcd7" podStartSLOduration=4.964077376 podStartE2EDuration="13.20178598s" totalImagesPullingTime="8.237708604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:42.20153024 +0000 UTC m=+13.802798254" watchObservedRunningTime="2026-11-02 13:42:42.20178598 +0000 UTC m=+13.803053994"
Nov 02 13:42:42.955664 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.954653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:42.955664 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:42.954774    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:42.955664 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:42.955466    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:42.955664 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:42.955587    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:43.951938 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:43.951893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:43.952691 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:43.952060    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:44.148221 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:44.148125    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="9e178215ca0de74d9f5324423954431a5eecb91aa8f4cb93aeb282b174d91c6a" exitCode=0
Nov 02 13:42:44.148221 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:44.148197    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerDied","Data":"9e178215ca0de74d9f5324423954431a5eecb91aa8f4cb93aeb282b174d91c6a"}
Nov 02 13:42:44.952699 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:44.952442    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:44.953189 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:44.952457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:44.953189 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:44.952817    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:44.953189 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:44.952953    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:45.154368 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:45.154327    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="2454a0f0db820f39fc428d70e99a0d7a0da6579b2c3b1d69b3c319d4c08e5e20" exitCode=0
Nov 02 13:42:45.154519 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:45.154397    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerDied","Data":"2454a0f0db820f39fc428d70e99a0d7a0da6579b2c3b1d69b3c319d4c08e5e20"}
Nov 02 13:42:45.952004 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:45.951959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:45.952247 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:45.952095    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:46.160228 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:46.160188    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" event={"ID":"f6993051-07c5-4982-ae6f-862d23237028","Type":"ContainerStarted","Data":"2676801d4280ecaaeb68e84b36f0771e36a63091407cb6c7598df4061421258b"}
Nov 02 13:42:46.187654 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:46.187605    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nh9mh" podStartSLOduration=6.660519548 podStartE2EDuration="17.187592892s" totalImagesPullingTime="10.527073344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:46.187187172 +0000 UTC m=+17.788455188" watchObservedRunningTime="2026-11-02 13:42:46.187592892 +0000 UTC m=+17.788860905"
Nov 02 13:42:46.571649 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:46.571407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:46.571649 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571556    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 13:42:46.571822 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571654    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 13:42:46.571822 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571676    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzcvk for pod openshift-network-diagnostics/network-check-target-zkqr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:46.571822 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571723    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:46.571822 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571738    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk podName:2dae05df-4c95-47be-895b-f711cc6119f4 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:02.571721055 +0000 UTC m=+34.172989049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzcvk" (UniqueName: "kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk") pod "network-check-target-zkqr7" (UID: "2dae05df-4c95-47be-895b-f711cc6119f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:42:46.571822 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571765    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs podName:3cc4a08b-8598-4bc2-851e-8bbd2854245b nodeName:}" failed. No retries permitted until 2026-11-02 13:43:02.571753306 +0000 UTC m=+34.173021298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs") pod "network-metrics-daemon-6xr2g" (UID: "3cc4a08b-8598-4bc2-851e-8bbd2854245b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:42:46.571822 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:46.571619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:46.571822 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:46.571799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:46.572155 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571881    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:46.572155 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.571911    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret podName:0aacf513-c851-4576-8689-d08f3c0c0ccb nodeName:}" failed. No retries permitted until 2026-11-02 13:43:02.571903658 +0000 UTC m=+34.173171650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret") pod "global-pull-secret-syncer-2lgfl" (UID: "0aacf513-c851-4576-8689-d08f3c0c0ccb") : object "kube-system"/"original-pull-secret" not registered
Nov 02 13:42:46.952604 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:46.952514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:46.952757 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.952697    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:46.952757 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:46.952742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:46.952856 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:46.952837    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:47.165958 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:47.165924    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"47d5653b81b1adb91bcbd19af7b4262530d8d83ec6f58482b2f87da89f63b2a7"}
Nov 02 13:42:47.166397 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:47.166000    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"b224aead2d612e7b458ffffa35a53b3faf96923bf768cb0995268e960bb8cea0"}
Nov 02 13:42:47.166397 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:47.166032    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"94493499dd5bdd3260139864cd1e8a93ede2371cd5f08c17ecbeaf5f14806b8b"}
Nov 02 13:42:47.166397 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:47.166063    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"344ba2a6d0ab60acef3b9b566058533d9b2b9a8330defd8c5b1dbee7c308abfb"}
Nov 02 13:42:47.166397 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:47.166107    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"b5dd2884cae8f945f65675b0625e481742f9f0949c888e825a6b298517e17296"}
Nov 02 13:42:47.166397 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:47.166136    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"77a07190d9e58fa21a1a111f582f7ac01440f6108f6249949ec35a445a7c33cf"}
Nov 02 13:42:47.952258 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:47.952217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:47.952419 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:47.952334    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:48.952366 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:48.952326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:48.952831 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:48.952549    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:48.952831 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:48.952580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:48.952831 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:48.952655    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:49.174264 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:49.174225    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"ee901a01791c9438b35df8e90598f45158f283333d87edfdbe8adc7cb4b6f0b7"}
Nov 02 13:42:49.952214 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:49.952176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:49.952373 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:49.952286    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:50.952290 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:50.952257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:50.952880 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:50.952257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:50.952880 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:50.952396    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:50.952880 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:50.952440    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:51.183118 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.183013    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" event={"ID":"df7f1d80-b01d-4626-ac19-b055f34313f3","Type":"ContainerStarted","Data":"7a064782ffa77c0404deed2477d71cc2120d41f657a822700c4fbaaf82732fd9"}
Nov 02 13:42:51.183370 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.183352    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:51.200019 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.199988    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:51.222489 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.222438    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" podStartSLOduration=7.079915074 podStartE2EDuration="22.22242335s" totalImagesPullingTime="15.142508276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:51.220820539 +0000 UTC m=+22.822088552" watchObservedRunningTime="2026-11-02 13:42:51.22242335 +0000 UTC m=+22.823691379"
Nov 02 13:42:51.471981 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.471891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:51.652330 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.652293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:51.867220 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.867182    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:51.951682 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.951651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:51.951876 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:51.951772    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:51.991389 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:51.991356    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:52.186036 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.185950    2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 13:42:52.186506 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.186484    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:52.205587 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.205513    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:52.635972 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.635755    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zkqr7"]
Nov 02 13:42:52.636181 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.636061    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:52.636181 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:52.636171    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:52.638792 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.638759    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2lgfl"]
Nov 02 13:42:52.638927 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.638899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:52.639029 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:52.639004    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:52.639551 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.639525    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xr2g"]
Nov 02 13:42:52.639666 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:52.639653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:52.639783 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:52.639761    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:53.187730 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:53.187703    2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 13:42:53.463714 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:53.463629    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:42:53.952612 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:53.952579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:53.952766 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:53.952693    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:53.952766 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:53.952749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:53.952853 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:53.952838    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:54.330804 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:54.330774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:54.952480 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:54.952443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:54.952663 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:54.952592    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:55.204000 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:55.203905    2576 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n" podUID="df7f1d80-b01d-4626-ac19-b055f34313f3" containerName="ovnkube-controller" probeResult="failure" output=""
Nov 02 13:42:55.952714 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:55.952628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:55.952714 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:55.952665    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:55.953223 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:55.952759    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:55.953223 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:55.952874    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:56.952488 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:56.952447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:56.952674 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:56.952589    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:57.254748 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.254655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:57.381275 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.381219    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:57.513387 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.513290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:57.660595 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.660566    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:57.811823 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.811789    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:57.945376 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.945350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:57.951599 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.951576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:57.951742 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:57.951697    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:57.951801 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:57.951749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:57.951899 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:57.951880    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:42:58.089651 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:58.089548    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:58.736143 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:58.736103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:58.884138 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:58.884103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:58.953277 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:58.953244    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:42:58.953412 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:58.953337    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:42:59.505536 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:59.505486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:59.636761 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:59.636728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:59.842347 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:59.842311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:42:59.952130 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:59.952096    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:42:59.952130 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:42:59.952139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:42:59.952370 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:59.952243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:42:59.952370 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:42:59.952356    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:00.015666 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:00.015617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:00.841351 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:00.841325    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w8cmr_09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba/dns-node-resolver/0.log"
Nov 02 13:43:00.951936 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:00.951895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:00.952361 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:00.952012    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:01.088262 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.088222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:01.231165 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.231080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:01.395388 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.395343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:01.700391 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.700353    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:01.841673 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.841645    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q5f2p_11cbc0ac-084e-4ded-81bf-51bc0ebdf74c/node-ca/0.log"
Nov 02 13:43:01.882990 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.882961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:01.952250 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.952154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:01.952250 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:01.952204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:01.952779 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:01.952286    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:01.952779 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:01.952393    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:02.015798 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:02.015764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:02.291740 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:02.291704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:02.429298 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:02.429268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:02.588349 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:02.588257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:02.588349 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:02.588299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:02.588349 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:02.588330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588421    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588444    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588481    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs podName:3cc4a08b-8598-4bc2-851e-8bbd2854245b nodeName:}" failed. No retries permitted until 2026-11-02 13:43:34.58846697 +0000 UTC m=+66.189734975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs") pod "network-metrics-daemon-6xr2g" (UID: "3cc4a08b-8598-4bc2-851e-8bbd2854245b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588499    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret podName:0aacf513-c851-4576-8689-d08f3c0c0ccb nodeName:}" failed. No retries permitted until 2026-11-02 13:43:34.588486774 +0000 UTC m=+66.189754765 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret") pod "global-pull-secret-syncer-2lgfl" (UID: "0aacf513-c851-4576-8689-d08f3c0c0ccb") : object "kube-system"/"original-pull-secret" not registered
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588446    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588520    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588534    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kzcvk for pod openshift-network-diagnostics/network-check-target-zkqr7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:43:02.588601 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.588570    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk podName:2dae05df-4c95-47be-895b-f711cc6119f4 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:34.588559538 +0000 UTC m=+66.189827531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzcvk" (UniqueName: "kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk") pod "network-check-target-zkqr7" (UID: "2dae05df-4c95-47be-895b-f711cc6119f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 02 13:43:02.952089 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:02.952040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:02.952239 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:02.952155    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:03.195202 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.195125    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:03.444968 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.444928    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:03.601778 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.601747    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:03.734092 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.734040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:03.868411 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.868327    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:03.951729 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.951691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:03.951729 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.951719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:03.951948 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:03.951808    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:03.951948 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:03.951931    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:03.999718 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:03.999683    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:04.151962 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:04.151879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:04.282806 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:04.282778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:04.417090 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:04.417001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:04.545892 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:04.545862    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:04.670106 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:04.669997    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:04.951792 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:04.951696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:04.951963 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:04.951807    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:04.991235 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:04.991199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:05.121978 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:05.121942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:05.404001 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:05.403971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:05.597881 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:05.597830    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:05.796678 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:05.796646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:05.930696 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:05.930649    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:05.951752 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:05.951722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:05.951752 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:05.951745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:05.951881 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:05.951850    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:05.951992 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:05.951973    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:06.190172 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:06.190096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:06.744314 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:06.744283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:06.893500 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:06.893464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:06.951970 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:06.951932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:06.952190 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:06.952053    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:07.036616 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:07.036589    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:07.175131 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:07.175060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:07.306422 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:07.306341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:07.449893 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:07.449860    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:07.599753 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:07.599660    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:07.952703 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:07.952605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:07.953206 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:07.952743    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:07.953206 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:07.952789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:07.953206 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:07.952874    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:08.000045 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:08.000007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:08.131028 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:08.130995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:08.266012 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:08.265927    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:08.598344 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:08.598299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:08.952484 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:08.952405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:08.952654 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:08.952513    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:09.402333 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:09.402301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:09.798896 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:09.798868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:09.952116 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:09.952057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:09.952310 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:09.952085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:09.952310 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:09.952191    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:09.952310 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:09.952266    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:09.999208 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:09.999172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:10.191402 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:10.191319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:10.345335 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:10.345292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:10.652478 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:10.652445    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:10.797941 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:10.797906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:10.952038 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:10.951970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:10.952180 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:10.952108    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:11.952698 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:11.952656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:11.953188 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:11.952671    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:11.953188 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:11.952812    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:11.953188 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:11.952843    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:12.952546 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:12.952511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:12.952748 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:12.952621    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:13.952333 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:13.952293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:13.952524 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:13.952295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:13.952524 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:13.952405    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:13.952524 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:13.952470    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:14.951825 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:14.951780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:14.952349 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:14.951918    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zkqr7" podUID="2dae05df-4c95-47be-895b-f711cc6119f4"
Nov 02 13:43:15.952311 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:15.952270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:15.952744 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:15.952386    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xr2g" podUID="3cc4a08b-8598-4bc2-851e-8bbd2854245b"
Nov 02 13:43:15.952744 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:15.952419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:15.952744 ip-10-0-131-166 kubenswrapper[2576]: E1102 13:43:15.952465    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lgfl" podUID="0aacf513-c851-4576-8689-d08f3c0c0ccb"
Nov 02 13:43:16.273572 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.273479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:16.477664 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.477621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:16.670491 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.670463    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeReady"
Nov 02 13:43:16.670672 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.670607    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 02 13:43:16.764973 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.764935    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k6nbb"]
Nov 02 13:43:16.766801 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.766783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.770344 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.770318    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gfpz8"]
Nov 02 13:43:16.772190 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.772166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:16.779526 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.779492    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k6nbb"]
Nov 02 13:43:16.783482 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.783449    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfpz8"]
Nov 02 13:43:16.795095 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.795040    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8qbcp"]
Nov 02 13:43:16.796970 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.796944    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.818349 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.818319    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8qbcp"]
Nov 02 13:43:16.840926 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.840889    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 13:43:16.841527 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.841509    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 13:43:16.841765 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.841720    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 13:43:16.841837 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.841792    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 13:43:16.841837 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.841805    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 13:43:16.842379 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.842359    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 13:43:16.842480 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.842453    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 13:43:16.842480 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.842462    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 13:43:16.843164 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.843148    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sw4zl\""
Nov 02 13:43:16.843227 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.843163    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-clq6z\""
Nov 02 13:43:16.843227 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.843181    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-cw7nr\""
Nov 02 13:43:16.843227 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.843208    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 13:43:16.890857 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.890752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e296d175-5e39-47c7-87fb-a11e6df8a494-data-volume\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.890857 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.890797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.890857 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.890819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0002f62b-5055-4220-8db5-114709282274-config-volume\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.891112 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.890890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88shs\" (UniqueName: \"kubernetes.io/projected/0002f62b-5055-4220-8db5-114709282274-kube-api-access-88shs\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.891112 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.891008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5w7q\" (UniqueName: \"kubernetes.io/projected/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-api-access-s5w7q\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.891112 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.891028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0002f62b-5055-4220-8db5-114709282274-metrics-tls\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.891112 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.891052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0002f62b-5055-4220-8db5-114709282274-tmp-dir\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.891112 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.891091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-cert\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:16.891313 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.891165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z6nv\" (UniqueName: \"kubernetes.io/projected/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-kube-api-access-2z6nv\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:16.891313 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.891224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e296d175-5e39-47c7-87fb-a11e6df8a494-crio-socket\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.891313 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.891252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e296d175-5e39-47c7-87fb-a11e6df8a494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.952336 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.952301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:16.957179 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.957151    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-tzjbd\""
Nov 02 13:43:16.957876 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.957857    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 13:43:16.957948 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.957934    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 13:43:16.992660 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e296d175-5e39-47c7-87fb-a11e6df8a494-crio-socket\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.992854 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e296d175-5e39-47c7-87fb-a11e6df8a494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.992854 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992694    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e296d175-5e39-47c7-87fb-a11e6df8a494-data-volume\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.992854 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.992854 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0002f62b-5055-4220-8db5-114709282274-config-volume\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.992854 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88shs\" (UniqueName: \"kubernetes.io/projected/0002f62b-5055-4220-8db5-114709282274-kube-api-access-88shs\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.992854 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5w7q\" (UniqueName: \"kubernetes.io/projected/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-api-access-s5w7q\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.993186 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e296d175-5e39-47c7-87fb-a11e6df8a494-crio-socket\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.993186 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0002f62b-5055-4220-8db5-114709282274-metrics-tls\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.993186 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0002f62b-5055-4220-8db5-114709282274-tmp-dir\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.993186 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.992996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-cert\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:16.993186 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.993026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z6nv\" (UniqueName: \"kubernetes.io/projected/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-kube-api-access-2z6nv\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:16.993186 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.993135    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e296d175-5e39-47c7-87fb-a11e6df8a494-data-volume\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.993468 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.993412    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0002f62b-5055-4220-8db5-114709282274-tmp-dir\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.993468 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.993444    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0002f62b-5055-4220-8db5-114709282274-config-volume\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.993556 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.993464    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.996833 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.996802    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0002f62b-5055-4220-8db5-114709282274-metrics-tls\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:16.996833 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.996816    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e296d175-5e39-47c7-87fb-a11e6df8a494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:16.996996 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:16.996878    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-cert\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:17.007356 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.007325    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z6nv\" (UniqueName: \"kubernetes.io/projected/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-kube-api-access-2z6nv\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:17.007534 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.007368    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5w7q\" (UniqueName: \"kubernetes.io/projected/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-api-access-s5w7q\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:17.007534 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.007469    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88shs\" (UniqueName: \"kubernetes.io/projected/0002f62b-5055-4220-8db5-114709282274-kube-api-access-88shs\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:17.082584 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.082545    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:17.087088 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.087043    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:17.109384 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.109348    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:17.379841 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.379805    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfpz8"]
Nov 02 13:43:17.384338 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.384303    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k6nbb"]
Nov 02 13:43:17.390939 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:17.390892    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode296d175_5e39_47c7_87fb_a11e6df8a494.slice/crio-96710488e145c2813b26fd0cc6e8942bbe28ff820c4be8cfe8ec66ea801dd7a9 WatchSource:0}: Error finding container 96710488e145c2813b26fd0cc6e8942bbe28ff820c4be8cfe8ec66ea801dd7a9: Status 404 returned error can't find the container with id 96710488e145c2813b26fd0cc6e8942bbe28ff820c4be8cfe8ec66ea801dd7a9
Nov 02 13:43:17.418710 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.418679    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8qbcp"]
Nov 02 13:43:17.422201 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:17.422173    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0002f62b_5055_4220_8db5_114709282274.slice/crio-e36b1c7eecc9f452dea6f2832e937a11ac8c198c073d61a914984704f8913dfe WatchSource:0}: Error finding container e36b1c7eecc9f452dea6f2832e937a11ac8c198c073d61a914984704f8913dfe: Status 404 returned error can't find the container with id e36b1c7eecc9f452dea6f2832e937a11ac8c198c073d61a914984704f8913dfe
Nov 02 13:43:17.952483 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.952445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:17.952902 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.952850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:17.957254 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.957225    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 13:43:17.958408 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.958386    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-m5gp5\""
Nov 02 13:43:17.958408 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.958390    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qngrq\""
Nov 02 13:43:17.958595 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:17.958426    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 13:43:18.249180 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:18.249128    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8qbcp" event={"ID":"0002f62b-5055-4220-8db5-114709282274","Type":"ContainerStarted","Data":"e36b1c7eecc9f452dea6f2832e937a11ac8c198c073d61a914984704f8913dfe"}
Nov 02 13:43:18.252271 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:18.252231    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6nbb" event={"ID":"e296d175-5e39-47c7-87fb-a11e6df8a494","Type":"ContainerStarted","Data":"88fa69a926fe4dba38b4a082b3e74a0826440ca124b88dfc69cb9c8bbb4c61ac"}
Nov 02 13:43:18.252419 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:18.252308    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6nbb" event={"ID":"e296d175-5e39-47c7-87fb-a11e6df8a494","Type":"ContainerStarted","Data":"96710488e145c2813b26fd0cc6e8942bbe28ff820c4be8cfe8ec66ea801dd7a9"}
Nov 02 13:43:18.254000 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:18.253974    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfpz8" event={"ID":"b207bcfa-5e2e-4190-ac0b-82a05dca20ec","Type":"ContainerStarted","Data":"96973058dee491c049a3ebef1154905312e6a08732c1e211b80950d6159b5755"}
Nov 02 13:43:19.004784 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:19.004722    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:19.152090 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:19.152033    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:19.259544 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:19.259431    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6nbb" event={"ID":"e296d175-5e39-47c7-87fb-a11e6df8a494","Type":"ContainerStarted","Data":"8ef6f7f58e4691a22ce14ecee11cd13b98a46d94175f3d88dd4667d81693e1d6"}
Nov 02 13:43:20.076342 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.076302    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:20.240571 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.240473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:20.267457 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.267416    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8qbcp" event={"ID":"0002f62b-5055-4220-8db5-114709282274","Type":"ContainerStarted","Data":"eb9eaee314166f3cff95a49ab69147fa805d5ee789e078228e4e80a41b059412"}
Nov 02 13:43:20.267591 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.267522    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8qbcp" event={"ID":"0002f62b-5055-4220-8db5-114709282274","Type":"ContainerStarted","Data":"200d5a7a4c41db8c1a8ac780d0c2c00c68b81691e010196133a2d8feb8a3de2a"}
Nov 02 13:43:20.267591 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.267556    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:20.270009 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.269980    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k6nbb" event={"ID":"e296d175-5e39-47c7-87fb-a11e6df8a494","Type":"ContainerStarted","Data":"64ba8861547c211509005dcf0bc391a139d8c356444d4003518b1e9b7b75885b"}
Nov 02 13:43:20.292340 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.292285    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-8qbcp" podStartSLOduration=2.475705718 podStartE2EDuration="4.292268167s" totalImagesPullingTime="1.816562449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:20.291506801 +0000 UTC m=+51.892774816" watchObservedRunningTime="2026-11-02 13:43:20.292268167 +0000 UTC m=+51.893536178"
Nov 02 13:43:20.329185 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:20.329129    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k6nbb" podStartSLOduration=1.955793828 podStartE2EDuration="4.329113545s" totalImagesPullingTime="2.373319717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:43:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:20.328778366 +0000 UTC m=+51.930046380" watchObservedRunningTime="2026-11-02 13:43:20.329113545 +0000 UTC m=+51.930381559"
Nov 02 13:43:21.274008 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:21.273975    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfpz8" event={"ID":"b207bcfa-5e2e-4190-ac0b-82a05dca20ec","Type":"ContainerStarted","Data":"05753853be263aed04462dd8b527204b6e77b01a096374866d3fbf26a9f5f190"}
Nov 02 13:43:21.299180 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:21.299123    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gfpz8" podStartSLOduration=2.426948613 podStartE2EDuration="5.299105197s" totalImagesPullingTime="2.872156584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:21.298423804 +0000 UTC m=+52.899691819" watchObservedRunningTime="2026-11-02 13:43:21.299105197 +0000 UTC m=+52.900373241"
Nov 02 13:43:21.879267 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:21.879228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:22.016567 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:22.016519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:22.292449 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:22.292414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:24.285910 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.285874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:24.429146 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.429112    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:24.473286 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.473247    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"]
Nov 02 13:43:24.476470 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.476450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.489201 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.489174    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 13:43:24.489201 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.489187    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 13:43:24.489201 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.489196    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 02 13:43:24.489476 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.489205    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-42t9j\""
Nov 02 13:43:24.489476 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.489231    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 13:43:24.489476 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.489243    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 02 13:43:24.489921 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.489904    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"]
Nov 02 13:43:24.492777 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.492759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.500672 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.500628    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"]
Nov 02 13:43:24.511124 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.511091    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 02 13:43:24.511124 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.511122    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 02 13:43:24.511342 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.511182    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v44xd\""
Nov 02 13:43:24.523431 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.523383    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4vmlv"]
Nov 02 13:43:24.526955 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.526920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.534707 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.534674    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"]
Nov 02 13:43:24.575750 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.575662    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gnlzz\""
Nov 02 13:43:24.576540 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.576522    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 13:43:24.576612 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.576542    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 13:43:24.591183 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.591153    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 13:43:24.591240 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.591173    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 02 13:43:24.656040 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.655996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.656040 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-textfile\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656285 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-wtmp\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656285 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.656285 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pglfg\" (UniqueName: \"kubernetes.io/projected/42958d29-5904-4838-a53c-09daea08f7ee-kube-api-access-pglfg\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656371 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.656371 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-metrics-client-ca\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656371 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d8613c-01dc-4cab-873e-543602bf77e8-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.656456 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656456 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h792s\" (UniqueName: \"kubernetes.io/projected/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-api-access-h792s\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.656456 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwr8g\" (UniqueName: \"kubernetes.io/projected/27d8613c-01dc-4cab-873e-543602bf77e8-kube-api-access-bwr8g\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.656540 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-tls\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656540 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-root\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656595 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656595 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-sys\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.656651 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.656683 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.656714 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.656747 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.656724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b25c973e-ffda-4a4e-b993-a7b497f0101f-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.705734 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.705700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:24.757678 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.757645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-wtmp\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.757678 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.757682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.758003 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.757706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pglfg\" (UniqueName: \"kubernetes.io/projected/42958d29-5904-4838-a53c-09daea08f7ee-kube-api-access-pglfg\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758003 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.757868    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-wtmp\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758142 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.758142 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-metrics-client-ca\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758142 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d8613c-01dc-4cab-873e-543602bf77e8-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.758142 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758309 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h792s\" (UniqueName: \"kubernetes.io/projected/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-api-access-h792s\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.758309 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwr8g\" (UniqueName: \"kubernetes.io/projected/27d8613c-01dc-4cab-873e-543602bf77e8-kube-api-access-bwr8g\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.758309 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-tls\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758453 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-root\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758453 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758453 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-sys\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758586 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-root\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758586 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758468    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-sys\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758586 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.758710 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.758710 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.758710 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b25c973e-ffda-4a4e-b993-a7b497f0101f-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.758710 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.758897 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-textfile\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.758987 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-metrics-client-ca\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.759046 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.758984    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d8613c-01dc-4cab-873e-543602bf77e8-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.759046 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.759018    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-textfile\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.759182 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.759100    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.759431 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.759407    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b25c973e-ffda-4a4e-b993-a7b497f0101f-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.759818 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.759692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.759818 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.759757    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.761039 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.761012    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.761418 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.761391    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.761496 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.761481    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.761987 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.761963    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.762370 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.762353    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.762734 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.762714    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-tls\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.796141 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.796099    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h792s\" (UniqueName: \"kubernetes.io/projected/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-api-access-h792s\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.796406 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.796388    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pglfg\" (UniqueName: \"kubernetes.io/projected/42958d29-5904-4838-a53c-09daea08f7ee-kube-api-access-pglfg\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.801734 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.801706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwr8g\" (UniqueName: \"kubernetes.io/projected/27d8613c-01dc-4cab-873e-543602bf77e8-kube-api-access-bwr8g\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:24.815593 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.815555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:24.843726 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.843690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:24.855697 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:24.855656    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42958d29_5904_4838_a53c_09daea08f7ee.slice/crio-71ddb9092cf81e7b11d6f6295129fb0aea1c8bd8652d372ac4adee382f7858f6 WatchSource:0}: Error finding container 71ddb9092cf81e7b11d6f6295129fb0aea1c8bd8652d372ac4adee382f7858f6: Status 404 returned error can't find the container with id 71ddb9092cf81e7b11d6f6295129fb0aea1c8bd8652d372ac4adee382f7858f6
Nov 02 13:43:24.864171 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:24.864141    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:25.092297 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.092203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:25.100590 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.100487    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"]
Nov 02 13:43:25.104134 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:25.104100    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25c973e_ffda_4a4e_b993_a7b497f0101f.slice/crio-70cefc22005ff367ef74ef2447797df3d23d405fd53e632c8ee4295e9dd675e2 WatchSource:0}: Error finding container 70cefc22005ff367ef74ef2447797df3d23d405fd53e632c8ee4295e9dd675e2: Status 404 returned error can't find the container with id 70cefc22005ff367ef74ef2447797df3d23d405fd53e632c8ee4295e9dd675e2
Nov 02 13:43:25.195642 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.195609    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:25.203417 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.203386    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:25.285886 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.285850    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7" event={"ID":"b25c973e-ffda-4a4e-b993-a7b497f0101f","Type":"ContainerStarted","Data":"70cefc22005ff367ef74ef2447797df3d23d405fd53e632c8ee4295e9dd675e2"}
Nov 02 13:43:25.287111 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.287059    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vmlv" event={"ID":"42958d29-5904-4838-a53c-09daea08f7ee","Type":"ContainerStarted","Data":"71ddb9092cf81e7b11d6f6295129fb0aea1c8bd8652d372ac4adee382f7858f6"}
Nov 02 13:43:25.378103 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.378050    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"]
Nov 02 13:43:25.380528 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:25.380497    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d8613c_01dc_4cab_873e_543602bf77e8.slice/crio-6620be109fafa4415e070d58c1d9b00fa0ddcafb4176b20d0a7f731dfeb92b8e WatchSource:0}: Error finding container 6620be109fafa4415e070d58c1d9b00fa0ddcafb4176b20d0a7f731dfeb92b8e: Status 404 returned error can't find the container with id 6620be109fafa4415e070d58c1d9b00fa0ddcafb4176b20d0a7f731dfeb92b8e
Nov 02 13:43:25.381063 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.381038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:25.517803 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.517739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:25.688634 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.688547    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:25.902849 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:25.902812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:26.090725 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:26.090632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:26.293490 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:26.293448    2576 generic.go:356] "Generic (PLEG): container finished" podID="42958d29-5904-4838-a53c-09daea08f7ee" containerID="2355098bd422dc18fbcf7d1369e4e93b204172e28d859bac9b62b1334b634a39" exitCode=0
Nov 02 13:43:26.294000 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:26.293558    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vmlv" event={"ID":"42958d29-5904-4838-a53c-09daea08f7ee","Type":"ContainerDied","Data":"2355098bd422dc18fbcf7d1369e4e93b204172e28d859bac9b62b1334b634a39"}
Nov 02 13:43:26.296008 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:26.295979    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c" event={"ID":"27d8613c-01dc-4cab-873e-543602bf77e8","Type":"ContainerStarted","Data":"9fb150658347e60197cee1f1f428abfe176ff292a5b3de49b6418296f66b14d5"}
Nov 02 13:43:26.296151 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:26.296039    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c" event={"ID":"27d8613c-01dc-4cab-873e-543602bf77e8","Type":"ContainerStarted","Data":"e4bd95e0d419a599c5a32bd70c804a41109d7dc16f8c4e35120a54806dc7e76b"}
Nov 02 13:43:26.296151 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:26.296093    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c" event={"ID":"27d8613c-01dc-4cab-873e-543602bf77e8","Type":"ContainerStarted","Data":"6620be109fafa4415e070d58c1d9b00fa0ddcafb4176b20d0a7f731dfeb92b8e"}
Nov 02 13:43:27.301738 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.301697    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7" event={"ID":"b25c973e-ffda-4a4e-b993-a7b497f0101f","Type":"ContainerStarted","Data":"bd2f75a991232ccf8c57f83f941299c64aa542a176f89574aa867ffd9a48e868"}
Nov 02 13:43:27.302253 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.301755    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7" event={"ID":"b25c973e-ffda-4a4e-b993-a7b497f0101f","Type":"ContainerStarted","Data":"8d2e863fd450cb06dcba105e0b42ee2ee9b6b7137ddfde6b5e65e7547568f475"}
Nov 02 13:43:27.302253 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.301776    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7" event={"ID":"b25c973e-ffda-4a4e-b993-a7b497f0101f","Type":"ContainerStarted","Data":"5c2b2c11be452a83af310b39559a437941b19cd1dcbea2c74c6b3e2aa249eb88"}
Nov 02 13:43:27.303917 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.303889    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vmlv" event={"ID":"42958d29-5904-4838-a53c-09daea08f7ee","Type":"ContainerStarted","Data":"0c072d494e9fd2f705ea84cc7da72a73a3652705abc4eda0906a5ca86e66fbe7"}
Nov 02 13:43:27.304060 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.303943    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vmlv" event={"ID":"42958d29-5904-4838-a53c-09daea08f7ee","Type":"ContainerStarted","Data":"64378541060c9185e8e76f51b274ba0c65a0e91cb2d05b89073f96c7428e52e5"}
Nov 02 13:43:27.306096 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.306052    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c" event={"ID":"27d8613c-01dc-4cab-873e-543602bf77e8","Type":"ContainerStarted","Data":"d35508cb8ba933fca07f72d794046a188ab4734a1001d2bee176aee698cf8f27"}
Nov 02 13:43:27.330356 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.330301    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7" podStartSLOduration=2.007457545 podStartE2EDuration="3.330285714s" totalImagesPullingTime="1.322828169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:27.328558151 +0000 UTC m=+58.929826164" watchObservedRunningTime="2026-11-02 13:43:27.330285714 +0000 UTC m=+58.931553767"
Nov 02 13:43:27.376676 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.376618    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c" podStartSLOduration=2.210832204 podStartE2EDuration="3.376599096s" totalImagesPullingTime="1.165766892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:27.376051998 +0000 UTC m=+58.977320013" watchObservedRunningTime="2026-11-02 13:43:27.376599096 +0000 UTC m=+58.977867112"
Nov 02 13:43:27.419781 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.419704    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4vmlv" podStartSLOduration=2.236808168 podStartE2EDuration="3.419683482s" totalImagesPullingTime="1.083351954s" totalInitContainerRuntime="99.52336ms" isStatefulPod=true podCreationTimestamp="2026-11-02 13:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:27.417952604 +0000 UTC m=+59.019220618" watchObservedRunningTime="2026-11-02 13:43:27.419683482 +0000 UTC m=+59.020951496"
Nov 02 13:43:27.488524 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.488487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:27.694472 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.694390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:27.850493 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:27.850463    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:29.319513 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.319481    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"]
Nov 02 13:43:29.323854 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.323833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.332770 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.332744    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"]
Nov 02 13:43:29.343721 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.343694    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 02 13:43:29.344002 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.343986    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bwkqn\""
Nov 02 13:43:29.349335 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.349310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:29.394820 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.394782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6ngl\" (UniqueName: \"kubernetes.io/projected/cc49235c-8639-439b-be7a-a34abd071d49-kube-api-access-v6ngl\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.394820 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.394822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc49235c-8639-439b-be7a-a34abd071d49-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.495899 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.495851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6ngl\" (UniqueName: \"kubernetes.io/projected/cc49235c-8639-439b-be7a-a34abd071d49-kube-api-access-v6ngl\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.495899 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.495898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc49235c-8639-439b-be7a-a34abd071d49-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.498728 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.498695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc49235c-8639-439b-be7a-a34abd071d49-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.509752 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.509711    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6ngl\" (UniqueName: \"kubernetes.io/projected/cc49235c-8639-439b-be7a-a34abd071d49-kube-api-access-v6ngl\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.557987 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.557955    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:29.635864 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.635761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:29.711099 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.710927    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:29.861489 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.861456    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:29.918744 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:29.918667    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"]
Nov 02 13:43:29.921991 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:29.921960    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc49235c_8639_439b_be7a_a34abd071d49.slice/crio-cd756138e18bddd6740499c8ddfd31d38e3cc80c92c884491cc3545ee6adb7e1 WatchSource:0}: Error finding container cd756138e18bddd6740499c8ddfd31d38e3cc80c92c884491cc3545ee6adb7e1: Status 404 returned error can't find the container with id cd756138e18bddd6740499c8ddfd31d38e3cc80c92c884491cc3545ee6adb7e1
Nov 02 13:43:30.276798 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.276715    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:30.318887 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.318807    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs" event={"ID":"cc49235c-8639-439b-be7a-a34abd071d49","Type":"ContainerStarted","Data":"cd756138e18bddd6740499c8ddfd31d38e3cc80c92c884491cc3545ee6adb7e1"}
Nov 02 13:43:30.967589 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.967553    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:43:30.972017 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.971984    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:30.984560 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.984521    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 02 13:43:30.985961 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.985937    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 02 13:43:30.985961 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.985957    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95485trdvqe3r\""
Nov 02 13:43:30.986196 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.985966    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 02 13:43:30.986196 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.985957    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 02 13:43:30.986196 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.986032    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5f49\""
Nov 02 13:43:30.986196 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.986086    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 02 13:43:30.986196 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.986119    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 02 13:43:30.986196 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.986134    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 02 13:43:30.986466 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.986214    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 02 13:43:30.986466 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.986287    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 02 13:43:30.986466 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.986407    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 02 13:43:30.999861 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:30.999827    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:43:31.010319 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010466 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010466 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010537 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010537 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010644 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010695 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010734 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010734 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010814 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010814 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010814 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010814 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010956 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010956 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010956 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp45b\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010956 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010956 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.010956 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.011381 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.010968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.051030 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.050996    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:31.081000 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.080970    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 02 13:43:31.081184 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.081025    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 02 13:43:31.081251 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.081238    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 02 13:43:31.081341 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.081325    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 02 13:43:31.084810 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.084776    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 02 13:43:31.112133 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112133 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112353 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112353 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112353 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112353 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112353 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112353 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112353 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.112713 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp45b\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.113204 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.112729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.113258 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.113242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.114574 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.113614    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.114574 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.113911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.114938 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.114906    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.115485 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.115455    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.115973 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.115946    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.116838 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.116742    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.116984 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.116817    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.117410 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.117377    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.118404 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.118226    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.118776 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.118755    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.119224 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.119197    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.119394 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.119371    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.119556 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.119531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.119783 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.119763    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.119886 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.119865    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.119886 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.119877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.121183 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.121158    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.121488 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.121461    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.134531 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.134483    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp45b\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.301178 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.301146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:31.328110 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.328043    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs" event={"ID":"cc49235c-8639-439b-be7a-a34abd071d49","Type":"ContainerStarted","Data":"6b6fcd070a1e6da8be21387977c12c45ce52cdc18d610f8707ae0d281dc80e19"}
Nov 02 13:43:31.328300 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.328278    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:31.333453 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.333420    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:31.354010 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.353881    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs" podStartSLOduration=1.074740402 podStartE2EDuration="2.353860253s" totalImagesPullingTime="1.279119851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:31.352885861 +0000 UTC m=+62.954153867" watchObservedRunningTime="2026-11-02 13:43:31.353860253 +0000 UTC m=+62.955128271"
Nov 02 13:43:31.596706 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:31.596676    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:43:31.600061 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:31.600017    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871026e6_bd87_4ba4_90c2_f87b2be0fdc0.slice/crio-ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f WatchSource:0}: Error finding container ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f: Status 404 returned error can't find the container with id ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f
Nov 02 13:43:32.334894 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:32.334857    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerStarted","Data":"ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f"}
Nov 02 13:43:33.340812 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:33.340774    2576 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="0fbc15eb18190c0abeecf486e20e330081082edbfdf34add5499dfa7a6fbf21f" exitCode=0
Nov 02 13:43:33.341342 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:33.340868    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"0fbc15eb18190c0abeecf486e20e330081082edbfdf34add5499dfa7a6fbf21f"}
Nov 02 13:43:34.644269 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.644212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:34.644269 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.644277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:34.644867 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.644313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:34.648647 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.648621    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 13:43:34.649815 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.649790    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 13:43:34.649932 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.649914    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 13:43:34.658019 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.657939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:34.658352 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.658318    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:34.658496 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.658479    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 13:43:34.668295 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.668266    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:34.771357 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.771326    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-m5gp5\""
Nov 02 13:43:34.778489 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.778452    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:34.784652 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.784625    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qngrq\""
Nov 02 13:43:34.791869 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.791836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:34.966378 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.966289    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-tzjbd\""
Nov 02 13:43:34.974374 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:34.974308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:35.085451 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:35.085406    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2lgfl"]
Nov 02 13:43:35.089130 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:35.089096    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aacf513_c851_4576_8689_d08f3c0c0ccb.slice/crio-4b8dbba02028148c389fd353b51c486d74fd5182ef259210ab50557cfa6c39e9 WatchSource:0}: Error finding container 4b8dbba02028148c389fd353b51c486d74fd5182ef259210ab50557cfa6c39e9: Status 404 returned error can't find the container with id 4b8dbba02028148c389fd353b51c486d74fd5182ef259210ab50557cfa6c39e9
Nov 02 13:43:35.100655 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:35.097664    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xr2g"]
Nov 02 13:43:35.106946 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:35.106901    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc4a08b_8598_4bc2_851e_8bbd2854245b.slice/crio-2375d6b36417c4e8e00619f4d029aef04384f6afaa902f08cd3913298a116908 WatchSource:0}: Error finding container 2375d6b36417c4e8e00619f4d029aef04384f6afaa902f08cd3913298a116908: Status 404 returned error can't find the container with id 2375d6b36417c4e8e00619f4d029aef04384f6afaa902f08cd3913298a116908
Nov 02 13:43:35.276834 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:35.276627    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zkqr7"]
Nov 02 13:43:35.279909 ip-10-0-131-166 kubenswrapper[2576]: W1102 13:43:35.279867    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dae05df_4c95_47be_895b_f711cc6119f4.slice/crio-3a35b71348b50664d68cf42b1fde634e5ac98f56e2ef024af31d70e47a4ca48f WatchSource:0}: Error finding container 3a35b71348b50664d68cf42b1fde634e5ac98f56e2ef024af31d70e47a4ca48f: Status 404 returned error can't find the container with id 3a35b71348b50664d68cf42b1fde634e5ac98f56e2ef024af31d70e47a4ca48f
Nov 02 13:43:35.349436 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:35.349400    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xr2g" event={"ID":"3cc4a08b-8598-4bc2-851e-8bbd2854245b","Type":"ContainerStarted","Data":"2375d6b36417c4e8e00619f4d029aef04384f6afaa902f08cd3913298a116908"}
Nov 02 13:43:35.350756 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:35.350721    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2lgfl" event={"ID":"0aacf513-c851-4576-8689-d08f3c0c0ccb","Type":"ContainerStarted","Data":"4b8dbba02028148c389fd353b51c486d74fd5182ef259210ab50557cfa6c39e9"}
Nov 02 13:43:35.352170 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:35.352140    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zkqr7" event={"ID":"2dae05df-4c95-47be-895b-f711cc6119f4","Type":"ContainerStarted","Data":"3a35b71348b50664d68cf42b1fde634e5ac98f56e2ef024af31d70e47a4ca48f"}
Nov 02 13:43:36.892411 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:36.892311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:37.037595 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:37.037481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:37.369612 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:37.369574    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xr2g" event={"ID":"3cc4a08b-8598-4bc2-851e-8bbd2854245b","Type":"ContainerStarted","Data":"b7838d4314400c1c2e7cb4fab526b5a8c7372224695c84aa3aba11d5506c6bfd"}
Nov 02 13:43:37.369785 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:37.369632    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xr2g" event={"ID":"3cc4a08b-8598-4bc2-851e-8bbd2854245b","Type":"ContainerStarted","Data":"a4a868e4a107143ba45ccad16f2d422abb52bc14d73430c193240ee5a3929c0e"}
Nov 02 13:43:37.373704 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:37.373665    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerStarted","Data":"3505df248a65187e22b990ebebc60defc35444023505cfc8c31b597812577c90"}
Nov 02 13:43:37.373864 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:37.373758    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerStarted","Data":"1a419530e20368e1636591e84517c5a2e7f25622fd6755b2ef39a0adf609c06a"}
Nov 02 13:43:37.400319 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:37.400214    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6xr2g" podStartSLOduration=68.127249227 podStartE2EDuration="1m9.400197395s" totalImagesPullingTime="1.272948168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:37.398977887 +0000 UTC m=+69.000245902" watchObservedRunningTime="2026-11-02 13:43:37.400197395 +0000 UTC m=+69.001465410"
Nov 02 13:43:38.910308 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:38.910222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:39.069010 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:39.068976    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:39.385284 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:39.384686    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zkqr7" event={"ID":"2dae05df-4c95-47be-895b-f711cc6119f4","Type":"ContainerStarted","Data":"1adce6c6faabd6028888e9e3b007650431da7b636b34daa1729bb101faf8a090"}
Nov 02 13:43:39.385284 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:39.384791    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:39.503597 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:39.503512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:39.707898 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:39.707856    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:39.855403 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:39.855352    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:40.393050 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.393003    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerStarted","Data":"c6baca638a46cf594eafae6f4f22a9e7c7cf0373f5829f298eaef52bac8defff"}
Nov 02 13:43:40.393537 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.393105    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerStarted","Data":"ce16f5c5c516a5594b8e95c818acd2cd93e9201ec03eaf2d4f2f651414435d73"}
Nov 02 13:43:40.393537 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.393143    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerStarted","Data":"1d282f60afa77f2364ebbcd5d1a804841ec8856822c2164a93a90b615fb2b2ac"}
Nov 02 13:43:40.393537 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.393178    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerStarted","Data":"85654c3d77d0d1250b96929b95bf5aea2153efb6a5adbee6ff02db9b28a9a538"}
Nov 02 13:43:40.440062 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.440004    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.426416269 podStartE2EDuration="10.439982335s" totalImagesPullingTime="6.992912957s" totalInitContainerRuntime="20.653109ms" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:40.439234299 +0000 UTC m=+72.040502314" watchObservedRunningTime="2026-11-02 13:43:40.439982335 +0000 UTC m=+72.041250367"
Nov 02 13:43:40.440717 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.440673    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zkqr7" podStartSLOduration=67.587106364 podStartE2EDuration="1m11.440664s" totalImagesPullingTime="3.853557636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:39.409291038 +0000 UTC m=+71.010559079" watchObservedRunningTime="2026-11-02 13:43:40.440664 +0000 UTC m=+72.041932060"
Nov 02 13:43:40.624374 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.624309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:40.765452 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.765418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:40.856869 ip-10-0-131-166 kubenswrapper[2576]: I1102 13:43:40.856821    2576 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 13:43:40.856945 ip-10-0-131-166 systemd[1]: Stopping Kubernetes Kubelet...
Nov 02 13:43:40.869579 ip-10-0-131-166 systemd[1]: kubelet.service: Deactivated successfully.
Nov 02 13:43:40.869762 ip-10-0-131-166 systemd[1]: Stopped Kubernetes Kubelet.
Nov 02 13:43:40.869817 ip-10-0-131-166 systemd[1]: kubelet.service: Consumed 4.499s CPU time.
Nov 02 13:43:40.884042 ip-10-0-131-166 systemd[1]: Starting Kubernetes Kubelet...
Nov 02 13:43:40.950882 ip-10-0-131-166 kubenswrapper[5453]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 13:43:40.950882 ip-10-0-131-166 kubenswrapper[5453]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 02 13:43:40.950882 ip-10-0-131-166 kubenswrapper[5453]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 13:43:40.950882 ip-10-0-131-166 kubenswrapper[5453]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 02 13:43:40.954387 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954266    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.954387 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954382    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.954387 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954389    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.954387 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954393    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.954387 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954398    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954404    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954410    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954415    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954419    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954423    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954427    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954431    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954434    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954437    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954441    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954444    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954448    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954452    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954457    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954461    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954465    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954469    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954472    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954476    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.954756 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954479    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954484    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954488    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954492    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954496    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954500    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954504    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954508    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954511    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954516    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954520    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954524    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954528    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954533    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954536    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954540    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954544    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954548    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954551    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954555    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.955646 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954559    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954564    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954568    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954572    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954577    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954581    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954587    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954592    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954596    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954600    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954605    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954609    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954613    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954617    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954621    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954626    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954631    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954635    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954639    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954645    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.956617 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954650    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954654    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954658    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954662    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954669    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954675    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954681    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954685    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954690    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954694    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954698    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954702    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954707    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954711    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954716    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954720    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954724    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954729    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954733    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.957478 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954740    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954744    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954749    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954752    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954757    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954762    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954766    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954770    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954776    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954780    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954785    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954789    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954794    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954798    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954803    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954806    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954813    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954818    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954822    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.958363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954826    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954831    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954835    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.954839    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956227    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956238    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956245    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956250    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956256    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956261    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956265    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956270    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956274    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956278    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956285    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956289    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956293    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956297    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956301    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.959249 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956306    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956310    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956315    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956319    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956323    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956328    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956333    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956337    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956341    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956345    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956349    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956354    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956358    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956363    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956367    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956371    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956376    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956380    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956384    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956388    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.960148 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956392    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956396    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956401    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956405    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956410    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956414    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956418    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956422    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956427    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956432    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956436    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956441    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956445    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956449    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956454    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956458    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956462    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956466    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956470    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956475    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.960984 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956478    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956483    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956487    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956492    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956496    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956500    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956504    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956509    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956513    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956517    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956521    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956525    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956529    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956533    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956537    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956542    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956546    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956550    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956554    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.961621 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956560    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956564    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956569    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956573    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956577    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956582    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956586    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956591    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956595    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956599    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956604    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956608    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956612    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956616    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956619    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956626    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956633    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956638    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956643    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956648    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.962131 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956652    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956657    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956661    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956670    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956676    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956681    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956686    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956690    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956694    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956699    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956703    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.956707    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957597    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957607    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957612    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957618    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957622    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957627    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957631    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.962638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957636    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957640    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957644    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957648    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957652    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957657    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957661    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957666    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957670    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957674    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957678    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957682    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957686    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957690    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957695    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957699    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957703    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957707    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957712    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.963219 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957716    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957720    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957724    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957728    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957733    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957737    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957741    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957745    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957749    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957755    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957759    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957764    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957768    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957772    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957776    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957780    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957784    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957788    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957792    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957797    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.963735 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957801    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957805    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957809    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957813    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957817    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957822    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957826    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957831    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957835    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957840    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957844    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957848    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957856    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957862    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957868    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957873    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957877    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957882    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957886    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957890    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.964279 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957896    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957900    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957905    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957909    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957914    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957918    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957922    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957927    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957931    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957935    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957939    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957943    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957947    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957951    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957956    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957961    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957965    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957969    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957973    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957977    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.964804 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957981    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957985    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957989    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957993    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.957998    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958002    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958006    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958012    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958017    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958022    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958027    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958031    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958036    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958040    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958045    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958050    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958054    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958058    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958062    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.958088    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.965322 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958241    5453 flags.go:64] FLAG: --address="0.0.0.0"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958255    5453 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958267    5453 flags.go:64] FLAG: --anonymous-auth="true"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958274    5453 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958282    5453 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958288    5453 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958295    5453 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958302    5453 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958307    5453 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958312    5453 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958317    5453 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958322    5453 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958328    5453 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958337    5453 flags.go:64] FLAG: --cgroup-root=""
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958342    5453 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958347    5453 flags.go:64] FLAG: --client-ca-file=""
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958351    5453 flags.go:64] FLAG: --cloud-provider="external"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958356    5453 flags.go:64] FLAG: --cluster-dns="[]"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958362    5453 flags.go:64] FLAG: --cluster-domain=""
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958367    5453 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958374    5453 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958378    5453 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958383    5453 flags.go:64] FLAG: --container-log-max-files="5"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958390    5453 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 02 13:43:40.965822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958394    5453 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958400    5453 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958405    5453 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958410    5453 flags.go:64] FLAG: --contention-profiling="false"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958416    5453 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958421    5453 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958426    5453 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958431    5453 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958438    5453 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958443    5453 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958448    5453 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958453    5453 flags.go:64] FLAG: --enable-load-reader="false"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958458    5453 flags.go:64] FLAG: --enable-server="true"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958463    5453 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958470    5453 flags.go:64] FLAG: --event-burst="100"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958476    5453 flags.go:64] FLAG: --event-qps="50"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958480    5453 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958485    5453 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958490    5453 flags.go:64] FLAG: --eviction-hard=""
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958497    5453 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958502    5453 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958509    5453 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958514    5453 flags.go:64] FLAG: --eviction-soft=""
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958519    5453 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958524    5453 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 02 13:43:40.966467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958528    5453 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958533    5453 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958538    5453 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958544    5453 flags.go:64] FLAG: --fail-swap-on="true"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958549    5453 flags.go:64] FLAG: --feature-gates=""
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958562    5453 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958567    5453 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958572    5453 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958577    5453 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958582    5453 flags.go:64] FLAG: --healthz-port="10248"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958587    5453 flags.go:64] FLAG: --help="false"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958592    5453 flags.go:64] FLAG: --hostname-override="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958598    5453 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958603    5453 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958608    5453 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958614    5453 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958619    5453 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958624    5453 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958629    5453 flags.go:64] FLAG: --image-service-endpoint=""
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958633    5453 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958638    5453 flags.go:64] FLAG: --kube-api-burst="100"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958643    5453 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958648    5453 flags.go:64] FLAG: --kube-api-qps="50"
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958652    5453 flags.go:64] FLAG: --kube-reserved=""
Nov 02 13:43:40.967102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958657    5453 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958662    5453 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958667    5453 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958672    5453 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958679    5453 flags.go:64] FLAG: --lock-file=""
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958683    5453 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958688    5453 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958694    5453 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958703    5453 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958708    5453 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958713    5453 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958720    5453 flags.go:64] FLAG: --logging-format="text"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958725    5453 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958730    5453 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958735    5453 flags.go:64] FLAG: --manifest-url=""
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958740    5453 flags.go:64] FLAG: --manifest-url-header=""
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958747    5453 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958752    5453 flags.go:64] FLAG: --max-open-files="1000000"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958758    5453 flags.go:64] FLAG: --max-pods="110"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958763    5453 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958768    5453 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958774    5453 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958780    5453 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958785    5453 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958790    5453 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 02 13:43:40.967710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958795    5453 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958807    5453 flags.go:64] FLAG: --node-status-max-images="50"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958812    5453 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958817    5453 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958822    5453 flags.go:64] FLAG: --pod-cidr=""
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958827    5453 flags.go:64] FLAG: --pod-manifest-path=""
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958832    5453 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958836    5453 flags.go:64] FLAG: --pods-per-core="0"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958841    5453 flags.go:64] FLAG: --port="10250"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958846    5453 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958851    5453 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0b560661d78d7360c"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958859    5453 flags.go:64] FLAG: --qos-reserved=""
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958864    5453 flags.go:64] FLAG: --read-only-port="10255"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958869    5453 flags.go:64] FLAG: --register-node="true"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958873    5453 flags.go:64] FLAG: --register-with-taints=""
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958879    5453 flags.go:64] FLAG: --registry-burst="10"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958884    5453 flags.go:64] FLAG: --registry-qps="5"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958889    5453 flags.go:64] FLAG: --reserved-cpus=""
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958895    5453 flags.go:64] FLAG: --reserved-memory=""
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958902    5453 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958907    5453 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958913    5453 flags.go:64] FLAG: --rotate-certificates="false"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958917    5453 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958922    5453 flags.go:64] FLAG: --runonce="false"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958927    5453 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958932    5453 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958937    5453 flags.go:64] FLAG: --seccomp-default="false"
Nov 02 13:43:40.968346 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958942    5453 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958947    5453 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958962    5453 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958967    5453 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958972    5453 flags.go:64] FLAG: --storage-driver-password="root"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958977    5453 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958982    5453 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958987    5453 flags.go:64] FLAG: --storage-driver-user="root"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958991    5453 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.958996    5453 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959001    5453 flags.go:64] FLAG: --system-cgroups=""
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959006    5453 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959014    5453 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959019    5453 flags.go:64] FLAG: --tls-cert-file=""
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959024    5453 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959031    5453 flags.go:64] FLAG: --tls-min-version=""
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959037    5453 flags.go:64] FLAG: --tls-private-key-file=""
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959042    5453 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959046    5453 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959051    5453 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959056    5453 flags.go:64] FLAG: --v="2"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959083    5453 flags.go:64] FLAG: --version="false"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959091    5453 flags.go:64] FLAG: --vmodule=""
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959100    5453 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959106    5453 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 02 13:43:40.969146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959373    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959382    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959395    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959400    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959405    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959409    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959413    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959417    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959422    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959426    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959441    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959446    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959450    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959455    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959459    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959463    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959468    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959473    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959477    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959482    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.969823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959486    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959490    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959495    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959501    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959505    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959509    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959513    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959518    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959522    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959526    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959534    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959538    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959542    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959546    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959550    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959555    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959559    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959563    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959568    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959572    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.970641 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959577    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959584    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959589    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959602    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959607    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959611    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959615    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959620    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959625    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959629    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959633    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959638    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959642    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959646    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959658    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959664    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959669    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959673    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959677    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.971420 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959681    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959685    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959689    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959698    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959705    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959710    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959714    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959719    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959723    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959728    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959733    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959737    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959742    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959746    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959751    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959755    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959759    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959771    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959776    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.972207 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959780    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959784    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959788    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959792    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959797    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959801    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959806    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959810    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959814    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959820    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959825    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959829    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959833    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959837    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959842    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959846    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959852    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959856    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959860    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959864    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.972706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959868    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959872    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959877    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959881    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959885    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959890    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959894    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.959899    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.959944    5453 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960023    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960033    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960046    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960052    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960057    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960062    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960085    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.973236 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960089    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960094    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960098    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960102    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960106    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960113    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960120    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960126    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960131    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960136    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960141    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960147    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960151    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960157    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960161    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960164    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960169    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960174    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960178    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.973626 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960183    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960187    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960191    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960196    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960200    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960204    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960208    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960213    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960218    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960233    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960239    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960243    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960247    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960253    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960257    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960261    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960265    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960269    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960275    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.974121 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960280    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960284    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960289    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960293    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960297    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960302    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960306    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960312    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960316    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960320    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960325    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960330    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960334    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960339    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960343    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960347    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960352    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960356    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960360    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960364    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.974622 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960368    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960372    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960376    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960389    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960393    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960397    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960402    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960406    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960411    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960416    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960420    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960426    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960430    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960435    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960438    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960443    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960447    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960451    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960455    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960461    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.975177 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960466    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960470    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960475    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960479    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960483    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960487    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960492    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960495    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960500    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960504    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960508    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960513    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960517    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960524    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960531    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960537    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960549    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960555    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960559    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960563    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.975696 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.960573    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.964932    5453 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.964954    5453 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.964972    5453 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.964977    5453 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965046    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965052    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965055    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965058    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965061    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965063    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965085    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965088    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965091    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965094    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965097    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965099    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965102    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965104    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.976200 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965107    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965110    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965112    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965115    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965117    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965120    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965123    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965127    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965130    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965135    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965137    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965140    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965143    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965146    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965148    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965151    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965153    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965156    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965159    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.976656 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965161    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965164    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965166    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965169    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965171    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965173    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965176    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965178    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965181    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965183    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965186    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965188    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965191    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965193    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965196    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965199    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965202    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965204    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965207    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965210    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.977146 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965213    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965215    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965218    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965221    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965223    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965226    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965228    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965231    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965233    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965235    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965238    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965241    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965244    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965246    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965248    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965251    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965253    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965256    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965258    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965261    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.977628 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965264    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965269    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965272    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965275    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965277    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965280    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965283    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965287    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965289    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965292    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965295    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965297    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965300    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965302    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965305    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965307    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965310    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965313    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965316    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965318    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.978162 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965321    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965324    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965326    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965329    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965332    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965334    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965337    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965339    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965342    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965345    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965347    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965349    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965353    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.965383    5453 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965530    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.978650 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965535    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965538    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965541    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965544    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965547    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965549    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965552    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965555    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965558    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965561    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965563    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965565    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965568    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965570    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965574    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965576    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965579    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965582    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965584    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965587    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.979021 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965589    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965592    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965594    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965597    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965599    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965602    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965604    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965606    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965608    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965611    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965613    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965616    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965618    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965620    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965623    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965626    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965629    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965632    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965635    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965637    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.979726 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965640    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965642    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965645    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965647    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965650    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965652    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965655    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965658    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965660    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965663    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965665    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965668    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965670    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965672    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965675    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965677    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965680    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965682    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965686    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965689    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.980233 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965692    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965695    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965697    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965700    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965702    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965704    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965707    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965710    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965713    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965715    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965718    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965720    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965723    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965725    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965728    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965730    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965732    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965735    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965737    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.980718 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965739    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965742    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965745    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965747    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965750    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965752    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965754    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965757    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965759    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965762    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965765    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965767    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965770    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965772    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965776    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965780    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965783    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965786    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965788    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.981197 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965791    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965794    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965796    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965799    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965801    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965803    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965806    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.965829    5453 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965887    5453 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965893    5453 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965897    5453 feature_gate.go:386] unrecognized feature gate: Example
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965900    5453 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965903    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965905    5453 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965908    5453 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 02 13:43:40.981671 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965912    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965914    5453 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965917    5453 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965920    5453 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965922    5453 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965925    5453 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965927    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965930    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965932    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965935    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965938    5453 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965940    5453 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965943    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965945    5453 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965948    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965950    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965953    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965955    5453 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965958    5453 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965960    5453 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 02 13:43:40.982037 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965962    5453 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965965    5453 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965967    5453 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965969    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965972    5453 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965975    5453 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965978    5453 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965981    5453 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965983    5453 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965986    5453 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965988    5453 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965990    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965993    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965996    5453 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.965998    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966001    5453 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966003    5453 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966005    5453 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966008    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966010    5453 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 02 13:43:40.982638 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966013    5453 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966015    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966018    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966020    5453 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966023    5453 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966025    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966028    5453 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966030    5453 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966032    5453 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966035    5453 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966038    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966041    5453 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966043    5453 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966045    5453 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966048    5453 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966050    5453 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966053    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966058    5453 feature_gate.go:386] unrecognized feature gate: Example2
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966061    5453 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966080    5453 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 02 13:43:40.983153 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966084    5453 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966087    5453 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966089    5453 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966094    5453 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966098    5453 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966101    5453 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966104    5453 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966107    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966110    5453 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966112    5453 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966115    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966117    5453 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966120    5453 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966123    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966125    5453 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966127    5453 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966130    5453 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966132    5453 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966135    5453 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 02 13:43:40.983673 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966137    5453 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966140    5453 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966142    5453 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966144    5453 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966147    5453 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966150    5453 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966152    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966154    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966157    5453 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966161    5453 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966166    5453 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966169    5453 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966171    5453 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966174    5453 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966176    5453 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966179    5453 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966183    5453 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966185    5453 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966188    5453 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 02 13:43:40.984314 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:43:40.966190    5453 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.966250    5453 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.967314    5453 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.967396    5453 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.967579    5453 server.go:1014] "Starting client certificate rotation"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.967731    5453 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.967784    5453 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 13:37:28 +0000 UTC" deadline="2028-04-20 20:55:39.105389172 +0000 UTC"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.967835    5453 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12847h11m58.137557377s"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.968170    5453 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.969727    5453 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.971531    5453 log.go:25] "Validated CRI v1 runtime API"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.973731    5453 log.go:25] "Validated CRI v1 image API"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.974595    5453 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 02 13:43:40.984783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.976685    5453 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ccef5dfc-40a6-4a75-9d3e-49d06b75bef3:/dev/nvme0n1p4 f1d26b2f-efd7-4500-9539-cec1b960506d:/dev/nvme0n1p3]
Nov 02 13:43:40.985158 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.976713    5453 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2375d6b36417c4e8e00619f4d029aef04384f6afaa902f08cd3913298a116908/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2375d6b36417c4e8e00619f4d029aef04384f6afaa902f08cd3913298a116908/userdata/shm major:0 minor:346 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a35b71348b50664d68cf42b1fde634e5ac98f56e2ef024af31d70e47a4ca48f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a35b71348b50664d68cf42b1fde634e5ac98f56e2ef024af31d70e47a4ca48f/userdata/shm major:0 minor:348 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6/userdata/shm major:0 minor:49 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4b8dbba02028148c389fd353b51c486d74fd5182ef259210ab50557cfa6c39e9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4b8dbba02028148c389fd353b51c486d74fd5182ef259210ab50557cfa6c39e9/userdata/shm major:0 minor:344 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4e0939553574a999931985f50b51cd574d9d0a1bede7727c9f4a2eddf280ced9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4e0939553574a999931985f50b51cd574d9d0a1bede7727c9f4a2eddf280ced9/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52422085088b1e897d3ce14b93c14759d33d28713fc22f1a4ecb58b814133719/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52422085088b1e897d3ce14b93c14759d33d28713fc22f1a4ecb58b814133719/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6359b8027d2fe29c9aa613844035cc2596e00aec94829b9a85dcf08868b53d67/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6359b8027d2fe29c9aa613844035cc2596e00aec94829b9a85dcf08868b53d67/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6620be109fafa4415e070d58c1d9b00fa0ddcafb4176b20d0a7f731dfeb92b8e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6620be109fafa4415e070d58c1d9b00fa0ddcafb4176b20d0a7f731dfeb92b8e/userdata/shm major:0 minor:265 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/70cefc22005ff367ef74ef2447797df3d23d405fd53e632c8ee4295e9dd675e2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/70cefc22005ff367ef74ef2447797df3d23d405fd53e632c8ee4295e9dd675e2/userdata/shm major:0 minor:259 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/71ddb9092cf81e7b11d6f6295129fb0aea1c8bd8652d372ac4adee382f7858f6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/71ddb9092cf81e7b11d6f6295129fb0aea1c8bd8652d372ac4adee382f7858f6/userdata/shm major:0 minor:261 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96710488e145c2813b26fd0cc6e8942bbe28ff820c4be8cfe8ec66ea801dd7a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96710488e145c2813b26fd0cc6e8942bbe28ff820c4be8cfe8ec66ea801dd7a9/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96973058dee491c049a3ebef1154905312e6a08732c1e211b80950d6159b5755/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96973058dee491c049a3ebef1154905312e6a08732c1e211b80950d6159b5755/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a64946fc354103dfc123152485bc8f028f8b80cc641a213b450b0f004503d11a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a64946fc354103dfc123152485bc8f028f8b80cc641a213b450b0f004503d11a/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aeeace9c93ba989d31e1ed72f7947820022666112771a2364881f78d24a57bab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aeeace9c93ba989d31e1ed72f7947820022666112771a2364881f78d24a57bab/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b49e146a5733fcde46d194549c7e5c50f3c86ef0a609782d236580ac2cf9185e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b49e146a5733fcde46d194549c7e5c50f3c86ef0a609782d236580ac2cf9185e/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cd756138e18bddd6740499c8ddfd31d38e3cc80c92c884491cc3545ee6adb7e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cd756138e18bddd6740499c8ddfd31d38e3cc80c92c884491cc3545ee6adb7e1/userdata/shm major:0 minor:315 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3e0419bc6a598e5f04be3e9aee8b04692c177f8f10b2dfb0c5ec45cdc799409/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3e0419bc6a598e5f04be3e9aee8b04692c177f8f10b2dfb0c5ec45cdc799409/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e36b1c7eecc9f452dea6f2832e937a11ac8c198c073d61a914984704f8913dfe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e36b1c7eecc9f452dea6f2832e937a11ac8c198c073d61a914984704f8913dfe/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff9b38baae1cdf93df8356d27f0f7859626e753d3773225f283ef852ce10f82c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff9b38baae1cdf93df8356d27f0f7859626e753d3773225f283ef852ce10f82c/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f/userdata/shm major:0 minor:333 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0002f62b-5055-4220-8db5-114709282274/volumes/kubernetes.io~projected/kube-api-access-88shs:{mountpoint:/var/lib/kubelet/pods/0002f62b-5055-4220-8db5-114709282274/volumes/kubernetes.io~projected/kube-api-access-88shs major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0002f62b-5055-4220-8db5-114709282274/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/0002f62b-5055-4220-8db5-114709282274/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~projected/kube-api-access-pl4qs:{mountpoint:/var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~projected/kube-api-access-pl4qs major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba/volumes/kubernetes.io~projected/kube-api-access-2pjnm:{mountpoint:/var/lib/kubelet/pods/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba/volumes/kubernetes.io~projected/kube-api-access-2pjnm major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0aacf513-c851-4576-8689-d08f3c0c0ccb/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/0aacf513-c851-4576-8689-d08f3c0c0ccb/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c/volumes/kubernetes.io~projected/kube-api-access-zjqmx:{mountpoint:/var/lib/kubelet/pods/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c/volumes/kubernetes.io~projected/kube-api-access-zjqmx major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~projected/kube-api-access-bwr8g:{mountpoint:/var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~projected/kube-api-access-bwr8g major:0 minor:258 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:253 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:254 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2dae05df-4c95-47be-895b-f711cc6119f4/volumes/kubernetes.io~projected/kube-api-access-kzcvk:{mountpoint:/var/lib/kubelet/pods/2dae05df-4c95-47be-895b-f711cc6119f4/volumes/kubernetes.io~projected/kube-api-access-kzcvk major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cc4a08b-8598-4bc2-851e-8bbd2854245b/volumes/kubernetes.io~projected/kube-api-access-tqctg:{mountpoint:/var/lib/kubelet/pods/3cc4a08b-8598-4bc2-851e-8bbd2854245b/volumes/kubernetes.io~projected/kube-api-access-tqctg major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cc4a08b-8598-4bc2-851e-8bbd2854245b/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/3cc4a08b-8598-4bc2-851e-8bbd2854245b/volumes/kubernetes.io~secret/metrics-certs major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~projected/kube-api-access-pglfg:{mountpoint:/var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~projected/kube-api-access-pglfg major:0 minor:257 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:252 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:255 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/59195bdc-66bf-4fe0-80a2-5f3a55add215/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/59195bdc-66bf-4fe0-80a2-5f3a55add215/volumes/kubernetes.io~secret/agent-certs major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b84bd6d-f423-4226-81b7-ce29872a76a8/volumes/kubernetes.io~projected/kube-api-access-gxkz9:{mountpoint:/var/lib/kubelet/pods/7b84bd6d-f423-4226-81b7-ce29872a76a8/volumes/kubernetes.io~projected/kube-api-access-gxkz9 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/config-reloader/2 major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/prometheus/15 major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~empty-dir/config-out major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~projected/kube-api-access-vp45b:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~projected/kube-api-access-vp45b major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~projected/tls-assets major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/config major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/web-config major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b1bb6b7-76a7-4770-949d-3a93833e2553/volumes/kubernetes.io~projected/kube-api-access-cpgxw:{mountpoint:/var/lib/kubelet/pods/8b1bb6b7-76a7-4770-949d-3a93833e2553/volumes/kubernetes.io~projected/kube-api-access-cpgxw major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b207bcfa-5e2e-4190-ac0b-82a05dca20ec/volumes/kubernetes.io~projected/kube-api-access-2z6nv:{mountpoint:/var/lib/kubelet/pods/b207bcfa-5e2e-4190-ac0b-82a05dca20ec/volumes/kubernetes.io~projected/kube-api-access-2z6nv major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b207bcfa-5e2e-4190-ac0b-82a05dca20ec/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/b207bcfa-5e2e-4190-ac0b-82a05dca20ec/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~projected/kube-api-access-h792s:{mountpoint:/var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~projected/kube-api-access-h792s major:0 minor:256 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:251 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc49235c-8639-439b-be7a-a34abd071d49/volumes/kubernetes.io~projected/kube-api-access-v6ngl:{mountpoint:/var/lib/kubelet/pods/cc49235c-8639-439b-be7a-a34abd071d49/volumes/kubernetes.io~projected/kube-api-access-v6ngl major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc49235c-8639-439b-be7a-a34abd071d49/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/cc49235c-8639-439b-be7a-a34abd071d49/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volumes/kubernetes.io~projected/kube-api-access-2t7mc:{mountpoint:/var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volumes/kubernetes.io~projected/kube-api-access-2t7mc major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e296d175-5e39-47c7-87fb-a11e6df8a494/volumes/kubernetes.io~projected/kube-api-access-s5w7q:{mountpoint:/var/lib/kubelet/pods/e296d175-5e39-47c7-87fb-a11e6df8a494/volumes/kubernetes.io~projected/kube-api-access-s5w7q major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e296d175-5e39-47c7-87fb-a11e6df8a494/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/e296d175-5e39-47c7-87fb-a11e6df8a494/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef/volumes/kubernetes.io~projected/kube-api-access-t6lx2:{mountpoint:/var/lib/kubelet/pods/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef/volumes/kubernetes.io~projected/kube-api-access-t6lx2 major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f6993051-07c5-4982-ae6f-862d23237028/volumes/kubernetes.io~projected/kube-api-access-49hcq:{mountpoint:/var/lib/kubelet/pods/f6993051-07c5-4982-ae6f-862d23237028/volumes/kubernetes.io~projected/kube-api-access-49hcq major:0 minor:65 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/d2f9b4fc76a67047a306326b7c5410e166c789a872187ffde43ace360c292a90/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/ee78cf70fa39b4ca3644e4c73e81eea65a917d7adf6687549343196ac7fe9a8d/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/5d6580144691e21673f786f8c74e0fe015eaf65b7d098bfd3812bff6d6f30543/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/fa7f5f74dfe01ec730cf186de570e177d1612e3c929573b965c617460f64d1c8/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/c2c36116504964641a43bee93246fb27448a32f4c0c57ef136e910103a610347/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/34956eff612506eb2c486fcf8d65408c745e73a733738d9e87ed0497f0c5d8b0/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/8cd3f388707ecba55c2f691e0e0105a9fe3fe66856c5b506a86987cb00b544ae/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/124937b38bc7dacc4a1a864a2c191e772451e225af8e1f02a8fe6eec0cb07cea/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/3aab6389495152ccffbfedc64c81bc21c0d80d30c35cbfc1837049ce51d18268/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/74c33920f2bb38f6b5ef5b4852d8cbacb7349c3538a2956a7054a5a5830b5a0b/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/5e738fd7cd523c49ffaa78c889e63fe50fd5bfb64df90d47ccec81d1d9c3b750/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/bb47fe210b8cdbebd5602c2390414966cdc0e04dcfdb2f6e14b215fd8806162d/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/7a19e5abf72a0464059979374255ec8a8d426622d57116904a708b735c501de2/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/45364affcc55871b08ee04e3fbd88e321306dcec89b46fe532a9f58530fbbbc5/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/ec3567e4300491f9417446b80def9f4797d45a8fcf131b8890b5517121b45e7d/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/62ee546e0c8726d87e10c7252e805dc9458ceb83aa3d5770f1e4b8fd855fcdba/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/ac97f8f3cf0256109b194005bd1bbde606396f59ff628fa308ef71488613acfc/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/67261ab1245a47c1315e44c6c4d310017f6bd13f75b7d1fffeb1bc27f1193b13/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/bcab0adbba03197c128e36aa6de3c9abf217cb0925c488616c08576815539b7e/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/754ef23ae565fbae3020ffd14dc6a248d6128561aa1bc7305bc38acd731cc47e/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/6455e8a92664bd021e849a72c9483dde638ddf2f52e1c60a8e357ab5bff20fa2/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/15494a53c77097384de15f31800d94047331bb060565c67c25d834c6d83cc453/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/17364ae37463077fd9bd06327c34a0058383af28b279224475ee4d4726c8d4e6/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/5db937ad2e33a1c6748646498022a3e155d78fd21297dfb4e92fb75f90a486b8/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/a53163817998b6896668db823db324a05367d10bf42bba39048aadc02ab70ff9/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/c0bf9107121bf1e7791e0aced51917ce28359e24ab7cbb1b7f0e2855dccb61a7/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/c8f8ae14c32643b93509bf6ede8729f29496026fad109f670e8bb3a33523baf0/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/1373d6703533568281aae7ca8848f17a56bfa8289b61d253231d8acdbc420b53/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/aeb97c817769f162720e2973693a74164ffd6aa07d49d2dbb1fe24c24887b82f/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/0c04ef8035015a58d5ef9a9493fb55a0376a8319e223d4bda816487a1976ef37/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-263:{mountpoint:/var/lib/containers/storage/overlay/3c9264b67756907937632df42c8cfc2d3e8642402574cb285a49f298392c6b64/merged major:0 minor:263 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/5dc615e95fa8801a3b756cf472544e602b639a18b0bd9e008b50ab26ca288771/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/2a51c44dc810cf0d65dc95c3353fab9dd0a3c73152fe4e05fe8f91a663a93a8a/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/992a892eb3c9d10b3530a7fa5524e9335c6cd906b5fd84b77dc4e9cc612d1991/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/5b3f3e47f3f5df2082dc06e7ec38d9b2447231cd90de748fa28427639129d44a/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/353d7765d710036671682111b7da5d0ee276c56c764f37da296df00c639e2c67/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/e73231e69e37b30da64bf0a9d12f027c2d09fce7e4056817e86a506e5fcc29b4/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/d3dc3412becf8470be206b84f0d953b3f4d37ba1f515857446252a2548e8dde4/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/9fcedf8b845bd49ce42881f53297ef6ce7d52c62cc7b9a441ca41dd324213d2c/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/41bad4de1bb74fd2cb163d132934b250e1bbaaa4f5adf8002eff08f51ee19278/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/0e277d14f6ae6bfe1f1cc4e66773d13f33c7c69b68ddb7b9ddb5d76fe9010c27/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/f1ee37e95ac3fe6075a97b38954f0928457adbc928658ab32770d7d6c9a12884/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-331:{mountpoint:/var/lib/containers/storage/overlay/2cdbf18bb42d58333fe0eea5793b17ce84c17b09fdba032ab21c99568ac308f7/merged major:0 minor:331 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/fac141b9557a2c157e9cbfe77155cbc5188587bfcc467899140d3b08f09fb711/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/4d78a25189d86795182ce39f553013ee44d3e5e267c5e7b050ccffd1ccc70ace/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/e8cf5dd56ab913428b93ee5f385af6fc58795d3d3ac742e1f8d505f709a22478/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/b40c998507524bf6b9321ba32f6c4b99661032939e33f5410b52920415c0e163/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/18ae6b44126753644eda992b52205ffc4e430ccf344b033823000c1375a99412/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/080abb72f52f5cfa64340d01d3e185ed401bc3904b6166ee9f25afad10b5ca81/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/98a57ef1f3f5991f1eab8845e72e10a95470ee04a2820fe29e9fb494d17e69a2/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/7ea9997bd5d4795189f1a1344c0f782c071cf5f423a065d8bb32d5a065282ef8/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/63826937d0d0b3f2f521bed3f0cb3711168eb464ab7132a2d3412f323ede38df/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/be41912d14edd09d9037c53bc889655b6d6c4ce2b8748b3cd7159c53c7b95c5c/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/80f177198dc4861f217d3e4444f9e7bcc1f1be8842bcf226a8fd53964431ab1d/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-391:{mountpoint:/var/lib/containers/storage/overlay/17a0f1d914534197fd312b95a0da554814ed874fe56a20e5ec2f0d1b4cb8c1a0/merged major:0 minor:391 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/cdcd4c7f5051259a736b7a9f996c05fdba3749a064e1578a4ce7ea3a28e959a0/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/ed568911f1d61d62d07882307ae4917cf4006065f76312678b63c590e7da5aca/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-50:{mountpoint:/var/lib/containers/storage/overlay/9561f64b030d90daa8a2445e25d45fe12a22dd86934020f52079ebdf8a8e2ada/merged major:0 minor:50 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/cd369d31e1254ed831ce5e3892a80f9f86eebe0528bd1cac3972b863786e85e9/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/60436de8775bb624add05efe2bb5bc1d543c17fb600e5549b40d7f7264677655/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/6cbebef7cc1fc4a9dd9312d00acf0ced995a609ad3b6afe9c604d21dc350d648/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/3f9e0829c6a7e4339ca70fd5f30641305271a5e0dc7c800ae4c8852a6c6dc42f/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/568c8545ac548996e4b9ec72fcee15c1249fa1ff3fba07968593ef1233bbd6f2/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/bb3aecb7097670f242db62c4f154bb95ad8a27c9488436d2280e34cd7eb12483/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/c9b8b02dc741481f5e40ef260eddbc94b0796648e599c04b17d106c796336905/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/7de7888bd1146d10c53969da140aad63fe6effeb510e5dc3dcaef9e7614432b7/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/0a3802bc52c6ab806b4d1e7b1323556a175db2adb083b94368e138f7fc77a21c/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 02 13:43:40.985834 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.985456    5453 manager.go:217] Machine: {Timestamp:2026-11-02 13:43:40.984912197 +0000 UTC m=+0.066057309 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100281 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd37fa2ebf5920203c5ddbd6ba32b SystemUUID:ec2dd37f-a2eb-f592-0203-c5ddbd6ba32b BootID:dd4141fc-a272-4ed7-bb70-f54d782e759f Filesystems:[{Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:328 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba/volumes/kubernetes.io~projected/kube-api-access-2pjnm DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b207bcfa-5e2e-4190-ac0b-82a05dca20ec/volumes/kubernetes.io~projected/kube-api-access-2z6nv DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cc49235c-8639-439b-be7a-a34abd071d49/volumes/kubernetes.io~projected/kube-api-access-v6ngl DeviceMajor:0 DeviceMinor:314 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:324 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52422085088b1e897d3ce14b93c14759d33d28713fc22f1a4ecb58b814133719/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:319 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8b1bb6b7-76a7-4770-949d-3a93833e2553/volumes/kubernetes.io~projected/kube-api-access-cpgxw DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~projected/kube-api-access-h792s DeviceMajor:0 DeviceMinor:256 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:252 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:322 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3cc4a08b-8598-4bc2-851e-8bbd2854245b/volumes/kubernetes.io~projected/kube-api-access-tqctg DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aeeace9c93ba989d31e1ed72f7947820022666112771a2364881f78d24a57bab/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4e0939553574a999931985f50b51cd574d9d0a1bede7727c9f4a2eddf280ced9/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6620be109fafa4415e070d58c1d9b00fa0ddcafb4176b20d0a7f731dfeb92b8e/userdata/shm DeviceMajor:0 DeviceMinor:265 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:327 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a64946fc354103dfc123152485bc8f028f8b80cc641a213b450b0f004503d11a/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:253 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:324 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0aacf513-c851-4576-8689-d08f3c0c0ccb/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:342 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~projected/kube-api-access-pl4qs DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3e0419bc6a598e5f04be3e9aee8b04692c177f8f10b2dfb0c5ec45cdc799409/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0002f62b-5055-4220-8db5-114709282274/volumes/kubernetes.io~projected/kube-api-access-88shs DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2375d6b36417c4e8e00619f4d029aef04384f6afaa902f08cd3913298a116908/userdata/shm DeviceMajor:0 DeviceMinor:346 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:324 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:324 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00b1feca-1c57-49db-a7a1-effee069ca7d/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0002f62b-5055-4220-8db5-114709282274/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:255 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/70cefc22005ff367ef74ef2447797df3d23d405fd53e632c8ee4295e9dd675e2/userdata/shm DeviceMajor:0 DeviceMinor:259 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~projected/kube-api-access-vp45b DeviceMajor:0 DeviceMinor:330 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4b8dbba02028148c389fd353b51c486d74fd5182ef259210ab50557cfa6c39e9/userdata/shm DeviceMajor:0 DeviceMinor:344 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/42958d29-5904-4838-a53c-09daea08f7ee/volumes/kubernetes.io~projected/kube-api-access-pglfg DeviceMajor:0 DeviceMinor:257 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-263 DeviceMajor:0 DeviceMinor:263 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3cc4a08b-8598-4bc2-851e-8bbd2854245b/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:341 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:320 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff9b38baae1cdf93df8356d27f0f7859626e753d3773225f283ef852ce10f82c/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cd756138e18bddd6740499c8ddfd31d38e3cc80c92c884491cc3545ee6adb7e1/userdata/shm DeviceMajor:0 DeviceMinor:315 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-331 DeviceMajor:0 DeviceMinor:331 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e36b1c7eecc9f452dea6f2832e937a11ac8c198c073d61a914984704f8913dfe/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2dae05df-4c95-47be-895b-f711cc6119f4/volumes/kubernetes.io~projected/kube-api-access-kzcvk DeviceMajor:0 DeviceMinor:343 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a35b71348b50664d68cf42b1fde634e5ac98f56e2ef024af31d70e47a4ca48f/userdata/shm DeviceMajor:0 DeviceMinor:348 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6/userdata/shm DeviceMajor:0 DeviceMinor:49 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96710488e145c2813b26fd0cc6e8942bbe28ff820c4be8cfe8ec66ea801dd7a9/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f/userdata/shm DeviceMajor:0 DeviceMinor:333 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e296d175-5e39-47c7-87fb-a11e6df8a494/volumes/kubernetes.io~projected/kube-api-access-s5w7q DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:326 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:329 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cc49235c-8639-439b-be7a-a34abd071d49/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:310 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/59195bdc-66bf-4fe0-80a2-5f3a55add215/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c/volumes/kubernetes.io~projected/kube-api-access-zjqmx DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:325 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e296d175-5e39-47c7-87fb-a11e6df8a494/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:251 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/71ddb9092cf81e7b11d6f6295129fb0aea1c8bd8652d372ac4adee382f7858f6/userdata/shm DeviceMajor:0 DeviceMinor:261 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:323 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b49e146a5733fcde46d194549c7e5c50f3c86ef0a609782d236580ac2cf9185e/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96973058dee491c049a3ebef1154905312e6a08732c1e211b80950d6159b5755/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6359b8027d2fe29c9aa613844035cc2596e00aec94829b9a85dcf08868b53d67/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-50 DeviceMajor:0 DeviceMinor:50 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/df7f1d80-b01d-4626-ac19-b055f34313f3/volumes/kubernetes.io~projected/kube-api-access-2t7mc DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f6993051-07c5-4982-ae6f-862d23237028/volumes/kubernetes.io~projected/kube-api-access-49hcq DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef/volumes/kubernetes.io~projected/kube-api-access-t6lx2 DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b25c973e-ffda-4a4e-b993-a7b497f0101f/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:246 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:254 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-391 DeviceMajor:0 DeviceMinor:391 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b207bcfa-5e2e-4190-ac0b-82a05dca20ec/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/27d8613c-01dc-4cab-873e-543602bf77e8/volumes/kubernetes.io~projected/kube-api-access-bwr8g DeviceMajor:0 DeviceMinor:258 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7b84bd6d-f423-4226-81b7-ce29872a76a8/volumes/kubernetes.io~projected/kube-api-access-gxkz9 DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:321 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:2375d6b36417c4e MacAddress:16:ec:27:46:ef:b7 Speed:10000 Mtu:8901} {Name:3a35b71348b5066 MacAddress:d6:21:cd:ec:2d:c1 Speed:10000 Mtu:8901} {Name:4b8dbba02028148 MacAddress:be:b0:83:5e:02:88 Speed:10000 Mtu:8901} {Name:6620be109fafa44 MacAddress:86:95:4c:b1:32:70 Speed:10000 Mtu:8901} {Name:70cefc22005ff36 MacAddress:f6:dc:7d:bd:0c:26 Speed:10000 Mtu:8901} {Name:96710488e145c28 MacAddress:76:8b:a4:70:02:14 Speed:10000 Mtu:8901} {Name:96973058dee491c MacAddress:aa:c2:6d:ea:f3:e5 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c5:da:27:41 Speed:0 Mtu:9001} {Name:br-int MacAddress:82:f0:6d:6f:bc:df Speed:0 Mtu:8901} {Name:cd756138e18bddd MacAddress:5a:36:38:6b:50:bd Speed:10000 Mtu:8901} {Name:e36b1c7eecc9f45 MacAddress:62:51:70:af:4e:02 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:c5:da:27:41 Speed:0 Mtu:9001} {Name:ffe838a8fc70213 MacAddress:56:3a:17:57:7c:dd Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:c6:e5:be:ee:59:91 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:a6:c0:12:7e:94:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 02 13:43:40.986033 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.985839    5453 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 02 13:43:40.986033 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.985893    5453 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 02 13:43:40.986258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986232    5453 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 02 13:43:40.986422 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986260    5453 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-166.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 02 13:43:40.986468 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986425    5453 topology_manager.go:143] "Creating topology manager with none policy"
Nov 02 13:43:40.986468 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986433    5453 container_manager_linux.go:311] "Creating device plugin manager"
Nov 02 13:43:40.986468 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986445    5453 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 13:43:40.986468 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986466    5453 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 02 13:43:40.986596 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986587    5453 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 02 13:43:40.986794 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986783    5453 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 02 13:43:40.986920 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986910    5453 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 02 13:43:40.986958 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986951    5453 kubelet.go:493] "Attempting to sync node with API server"
Nov 02 13:43:40.986987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986961    5453 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 02 13:43:40.986987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986972    5453 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 02 13:43:40.986987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986982    5453 kubelet.go:405] "Adding apiserver pod source"
Nov 02 13:43:40.987298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.986992    5453 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 02 13:43:40.987957 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.987938    5453 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 13:43:40.987957 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.987955    5453 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 13:43:40.990212 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.989292    5453 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 02 13:43:40.992829 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.992809    5453 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 02 13:43:40.992829 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.992825    5453 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 02 13:43:40.992970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.992957    5453 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 02 13:43:40.993193 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993181    5453 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 02 13:43:40.993227 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993212    5453 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 02 13:43:40.993318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993309    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993323    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993330    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993335    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993341    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993347    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993354    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993359    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993367    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993373    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993388    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 02 13:43:40.993405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993398    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 02 13:43:40.993835 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993427    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 02 13:43:40.993835 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.993432    5453 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 02 13:43:40.997050 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.997032    5453 server.go:1263] "Started kubelet"
Nov 02 13:43:40.997186 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.997129    5453 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 02 13:43:40.997261 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.997164    5453 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 02 13:43:40.997261 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.997237    5453 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 02 13:43:40.997591 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.997570    5453 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 02 13:43:40.997692 ip-10-0-131-166 systemd[1]: Started Kubernetes Kubelet.
Nov 02 13:43:40.999101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:40.998664    5453 server.go:317] "Adding debug handlers to kubelet server"
Nov 02 13:43:41.002562 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.002527    5453 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 02 13:43:41.002887 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.002595    5453 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.006163    5453 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.006197    5453 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.006611    5453 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.006952    5453 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 13:37:30 +0000 UTC" deadline="2028-04-14 23:15:04.846602564 +0000 UTC"
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.006986    5453 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12705h31m23.839621406s"
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:41.002637    5453 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-166.us-east-2.compute.internal\" not found"
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.009491    5453 factory.go:55] Registering systemd factory
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.009517    5453 factory.go:223] Registration of the systemd container factory successfully
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.010148    5453 factory.go:153] Registering CRI-O factory
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.010170    5453 factory.go:223] Registration of the crio container factory successfully
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.010372    5453 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.010401    5453 factory.go:103] Registering Raw factory
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.010452    5453 manager.go:1199] Started watching for new ooms in manager
Nov 02 13:43:41.011925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.010986    5453 manager.go:319] Starting recovery of all containers
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.012894    5453 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.012983    5453 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013408    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config" seLinuxMountContext=""
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013448    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6993051-07c5-4982-ae6f-862d23237028" volumeName="kubernetes.io/projected/f6993051-07c5-4982-ae6f-862d23237028-kube-api-access-49hcq" seLinuxMountContext=""
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013464    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0002f62b-5055-4220-8db5-114709282274" volumeName="kubernetes.io/projected/0002f62b-5055-4220-8db5-114709282274-kube-api-access-88shs" seLinuxMountContext=""
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013480    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00b1feca-1c57-49db-a7a1-effee069ca7d" volumeName="kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-tmp" seLinuxMountContext=""
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013494    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42958d29-5904-4838-a53c-09daea08f7ee" volumeName="kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-metrics-client-ca" seLinuxMountContext=""
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013507    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013519    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Nov 02 13:43:41.013520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013529    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e296d175-5e39-47c7-87fb-a11e6df8a494" volumeName="kubernetes.io/secret/e296d175-5e39-47c7-87fb-a11e6df8a494-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013544    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba" volumeName="kubernetes.io/projected/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-kube-api-access-2pjnm" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013556    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2dae05df-4c95-47be-895b-f711cc6119f4" volumeName="kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013568    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cc4a08b-8598-4bc2-851e-8bbd2854245b" volumeName="kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013580    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42958d29-5904-4838-a53c-09daea08f7ee" volumeName="kubernetes.io/empty-dir/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-textfile" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013593    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013608    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b25c973e-ffda-4a4e-b993-a7b497f0101f" volumeName="kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013623    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b25c973e-ffda-4a4e-b993-a7b497f0101f" volumeName="kubernetes.io/projected/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-api-access-h792s" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013637    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cc4a08b-8598-4bc2-851e-8bbd2854245b" volumeName="kubernetes.io/projected/3cc4a08b-8598-4bc2-851e-8bbd2854245b-kube-api-access-tqctg" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013652    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b84bd6d-f423-4226-81b7-ce29872a76a8" volumeName="kubernetes.io/projected/7b84bd6d-f423-4226-81b7-ce29872a76a8-kube-api-access-gxkz9" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013664    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b1bb6b7-76a7-4770-949d-3a93833e2553" volumeName="kubernetes.io/projected/8b1bb6b7-76a7-4770-949d-3a93833e2553-kube-api-access-cpgxw" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013677    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b25c973e-ffda-4a4e-b993-a7b497f0101f" volumeName="kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013692    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc49235c-8639-439b-be7a-a34abd071d49" volumeName="kubernetes.io/secret/cc49235c-8639-439b-be7a-a34abd071d49-monitoring-plugin-cert" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013705    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e296d175-5e39-47c7-87fb-a11e6df8a494" volumeName="kubernetes.io/configmap/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013719    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eddfdae8-aa30-4e31-b3f9-2e614f5b3cef" volumeName="kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cni-binary-copy" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013732    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba" volumeName="kubernetes.io/empty-dir/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-tmp-dir" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013745    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27d8613c-01dc-4cab-873e-543602bf77e8" volumeName="kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013760    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42958d29-5904-4838-a53c-09daea08f7ee" volumeName="kubernetes.io/projected/42958d29-5904-4838-a53c-09daea08f7ee-kube-api-access-pglfg" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013778    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df7f1d80-b01d-4626-ac19-b055f34313f3" volumeName="kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-env-overrides" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013791    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df7f1d80-b01d-4626-ac19-b055f34313f3" volumeName="kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-script-lib" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013833    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6993051-07c5-4982-ae6f-862d23237028" volumeName="kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-binary-copy" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013853    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6993051-07c5-4982-ae6f-862d23237028" volumeName="kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013868    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013882    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013896    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013909    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df7f1d80-b01d-4626-ac19-b055f34313f3" volumeName="kubernetes.io/projected/df7f1d80-b01d-4626-ac19-b055f34313f3-kube-api-access-2t7mc" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013931    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0002f62b-5055-4220-8db5-114709282274" volumeName="kubernetes.io/empty-dir/0002f62b-5055-4220-8db5-114709282274-tmp-dir" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013944    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42958d29-5904-4838-a53c-09daea08f7ee" volumeName="kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013957    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013972    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b207bcfa-5e2e-4190-ac0b-82a05dca20ec" volumeName="kubernetes.io/projected/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-kube-api-access-2z6nv" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.013986    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6993051-07c5-4982-ae6f-862d23237028" volumeName="kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014000    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27d8613c-01dc-4cab-873e-543602bf77e8" volumeName="kubernetes.io/projected/27d8613c-01dc-4cab-873e-543602bf77e8-kube-api-access-bwr8g" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014016    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b84bd6d-f423-4226-81b7-ce29872a76a8" volumeName="kubernetes.io/configmap/7b84bd6d-f423-4226-81b7-ce29872a76a8-iptables-alerter-script" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014030    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b207bcfa-5e2e-4190-ac0b-82a05dca20ec" volumeName="kubernetes.io/secret/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-cert" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014045    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df7f1d80-b01d-4626-ac19-b055f34313f3" volumeName="kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-config" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014059    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0002f62b-5055-4220-8db5-114709282274" volumeName="kubernetes.io/configmap/0002f62b-5055-4220-8db5-114709282274-config-volume" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014090    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0002f62b-5055-4220-8db5-114709282274" volumeName="kubernetes.io/secret/0002f62b-5055-4220-8db5-114709282274-metrics-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014105    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014149    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014162    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e296d175-5e39-47c7-87fb-a11e6df8a494" volumeName="kubernetes.io/projected/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-api-access-s5w7q" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014178    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014194    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014207    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014221    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eddfdae8-aa30-4e31-b3f9-2e614f5b3cef" volumeName="kubernetes.io/projected/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-kube-api-access-t6lx2" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014231    5453 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014235    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00b1feca-1c57-49db-a7a1-effee069ca7d" volumeName="kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-tuned" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014252    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0aacf513-c851-4576-8689-d08f3c0c0ccb" volumeName="kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014265    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42958d29-5904-4838-a53c-09daea08f7ee" volumeName="kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014278    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59195bdc-66bf-4fe0-80a2-5f3a55add215" volumeName="kubernetes.io/configmap/59195bdc-66bf-4fe0-80a2-5f3a55add215-konnectivity-ca" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014291    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df7f1d80-b01d-4626-ac19-b055f34313f3" volumeName="kubernetes.io/secret/df7f1d80-b01d-4626-ac19-b055f34313f3-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014314    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e296d175-5e39-47c7-87fb-a11e6df8a494" volumeName="kubernetes.io/empty-dir/e296d175-5e39-47c7-87fb-a11e6df8a494-data-volume" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014329    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eddfdae8-aa30-4e31-b3f9-2e614f5b3cef" volumeName="kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-daemon-config" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014342    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00b1feca-1c57-49db-a7a1-effee069ca7d" volumeName="kubernetes.io/projected/00b1feca-1c57-49db-a7a1-effee069ca7d-kube-api-access-pl4qs" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014355    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42958d29-5904-4838-a53c-09daea08f7ee" volumeName="kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014368    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014382    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11cbc0ac-084e-4ded-81bf-51bc0ebdf74c" volumeName="kubernetes.io/projected/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-kube-api-access-zjqmx" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014395    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014409    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b25c973e-ffda-4a4e-b993-a7b497f0101f" volumeName="kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-metrics-client-ca" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014422    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b25c973e-ffda-4a4e-b993-a7b497f0101f" volumeName="kubernetes.io/empty-dir/b25c973e-ffda-4a4e-b993-a7b497f0101f-volume-directive-shadow" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014436    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc49235c-8639-439b-be7a-a34abd071d49" volumeName="kubernetes.io/projected/cc49235c-8639-439b-be7a-a34abd071d49-kube-api-access-v6ngl" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014449    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27d8613c-01dc-4cab-873e-543602bf77e8" volumeName="kubernetes.io/configmap/27d8613c-01dc-4cab-873e-543602bf77e8-metrics-client-ca" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014463    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="27d8613c-01dc-4cab-873e-543602bf77e8" volumeName="kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014478    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59195bdc-66bf-4fe0-80a2-5f3a55add215" volumeName="kubernetes.io/secret/59195bdc-66bf-4fe0-80a2-5f3a55add215-agent-certs" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014493    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014506    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014518    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014530    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b25c973e-ffda-4a4e-b993-a7b497f0101f" volumeName="kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-tls" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014545    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11cbc0ac-084e-4ded-81bf-51bc0ebdf74c" volumeName="kubernetes.io/configmap/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-serviceca" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014557    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014572    5453 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" volumeName="kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out" seLinuxMountContext=""
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014584    5453 reconstruct.go:97] "Volume reconstruction finished"
Nov 02 13:43:41.015318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.014593    5453 reconciler.go:29] "Reconciler: start to sync state"
Nov 02 13:43:41.018863 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.018332    5453 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 02 13:43:41.034223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.034185    5453 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 02 13:43:41.036147 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.035947    5453 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 02 13:43:41.036147 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.035981    5453 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 02 13:43:41.036147 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.036010    5453 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 02 13:43:41.036147 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:41.036053    5453 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 02 13:43:41.041370 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.041332    5453 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 02 13:43:41.063809 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.063763    5453 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="0fbc15eb18190c0abeecf486e20e330081082edbfdf34add5499dfa7a6fbf21f" exitCode=0
Nov 02 13:43:41.066533 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.066501    5453 generic.go:356] "Generic (PLEG): container finished" podID="42958d29-5904-4838-a53c-09daea08f7ee" containerID="2355098bd422dc18fbcf7d1369e4e93b204172e28d859bac9b62b1334b634a39" exitCode=0
Nov 02 13:43:41.073622 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.073584    5453 generic.go:356] "Generic (PLEG): container finished" podID="0c54cde61181c8e33c72b5d5e568694e" containerID="f463526aae57f0098dc4dc410682920dec6f31c5ad7403dfb00519d6fc3962b0" exitCode=0
Nov 02 13:43:41.088358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.088323    5453 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="2454a0f0db820f39fc428d70e99a0d7a0da6579b2c3b1d69b3c319d4c08e5e20" exitCode=0
Nov 02 13:43:41.088358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.088352    5453 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="9e178215ca0de74d9f5324423954431a5eecb91aa8f4cb93aeb282b174d91c6a" exitCode=0
Nov 02 13:43:41.088358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.088360    5453 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="82ac5c4667717a89f6b271d45e30bff8e6814346d1192f106fae2d2c668b72b3" exitCode=0
Nov 02 13:43:41.088358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.088367    5453 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="8869ca5720f0b13de2ec1101e0f938e38ff1afd9b1d4fddddc29dfd50c0ab057" exitCode=0
Nov 02 13:43:41.088358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.088372    5453 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="45fd9b80ceef0980e05c6fef4734c2d41809aaabb6c1bdb96cbf52caaa6755a3" exitCode=0
Nov 02 13:43:41.088746 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.088377    5453 generic.go:356] "Generic (PLEG): container finished" podID="f6993051-07c5-4982-ae6f-862d23237028" containerID="1a349b1af12d26d43fc2533f87db65d687ca9d1ce58bf37ac4b56d475ed8e0e8" exitCode=0
Nov 02 13:43:41.117995 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.117970    5453 manager.go:324] Recovery completed
Nov 02 13:43:41.136148 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:41.136116    5453 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 02 13:43:41.139858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.139835    5453 cpu_manager.go:226] "Starting" policy="none"
Nov 02 13:43:41.139858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.139851    5453 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 02 13:43:41.140022 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.139874    5453 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 02 13:43:41.140022 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140005    5453 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 02 13:43:41.140112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140016    5453 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 02 13:43:41.140112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140035    5453 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 02 13:43:41.140112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140040    5453 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 02 13:43:41.140112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140046    5453 policy_none.go:50] "Start"
Nov 02 13:43:41.140112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140054    5453 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 02 13:43:41.140112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140063    5453 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 02 13:43:41.140266 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140207    5453 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 02 13:43:41.140266 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140214    5453 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 02 13:43:41.140266 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.140220    5453 policy_none.go:44] "Start"
Nov 02 13:43:41.146759 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.146723    5453 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 02 13:43:41.149556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.149530    5453 manager.go:341] "Starting Device Plugin manager"
Nov 02 13:43:41.150204 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:41.149562    5453 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 02 13:43:41.150255 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150208    5453 server.go:87] "Starting device plugin registration server"
Nov 02 13:43:41.150504 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150494    5453 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 02 13:43:41.150537 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150507    5453 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 02 13:43:41.150679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150658    5453 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 02 13:43:41.150811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150775    5453 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 02 13:43:41.150862 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150822    5453 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 02 13:43:41.150862 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150832    5453 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 02 13:43:41.150972 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.150863    5453 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T13:43:41.150810256Z","UUID":"85406ecb-0a32-4f66-86f5-207b687bce63","Handler":null,"Name":"","Endpoint":""}
Nov 02 13:43:41.152507 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.152483    5453 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 02 13:43:41.152507 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.152508    5453 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 02 13:43:41.152785 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:41.152755    5453 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 02 13:43:41.251044 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.250947    5453 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 02 13:43:41.254210 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.254186    5453 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 02 13:43:41.254356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.254223    5453 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 02 13:43:41.254356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.254234    5453 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-166.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 02 13:43:41.254356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.254309    5453 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.270856 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.270827    5453 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.271004 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.270909    5453 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.336684 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.336624    5453 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"]
Nov 02 13:43:41.337350 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.337332    5453 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.337450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.337362    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"8d5883c7dbe396f1be7fa323b910e645","Type":"ContainerStarted","Data":"69175b7f9ec55d70deba819e61aaad5565f2bb526498b486384e58e174b27e1a"}
Nov 02 13:43:41.337450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.337403    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"8d5883c7dbe396f1be7fa323b910e645","Type":"ContainerStarted","Data":"471ece856da8f1dce289d3c07fe3e3c6891e7930252d1ae0c008ac40792906c6"}
Nov 02 13:43:41.337450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.337416    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"0c54cde61181c8e33c72b5d5e568694e","Type":"ContainerStarted","Data":"b3478115c01a0ac9aef95fa354632ba92e8b7538722c30c9f8a1911be490b66e"}
Nov 02 13:43:41.337450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.337427    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"0c54cde61181c8e33c72b5d5e568694e","Type":"ContainerDied","Data":"f463526aae57f0098dc4dc410682920dec6f31c5ad7403dfb00519d6fc3962b0"}
Nov 02 13:43:41.337450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.337439    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal" event={"ID":"0c54cde61181c8e33c72b5d5e568694e","Type":"ContainerStarted","Data":"47a5ea1e3f0e41b0f5a4be3f971d69e27043a6c2fe2bd26eb1056419c3b1e7a4"}
Nov 02 13:43:41.337698 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.337599    5453 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.354354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.354323    5453 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 13:43:41.354511 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:41.354386    5453 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.359889 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.359864    5453 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 13:43:41.359948 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:41.359930    5453 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.420319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.420273    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d5883c7dbe396f1be7fa323b910e645-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"8d5883c7dbe396f1be7fa323b910e645\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.420319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.420316    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.420535 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.420345    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.521021 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.520930    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d5883c7dbe396f1be7fa323b910e645-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"8d5883c7dbe396f1be7fa323b910e645\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.521021 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.520972    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.521256 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.521027    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.521256 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.521039    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d5883c7dbe396f1be7fa323b910e645-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"8d5883c7dbe396f1be7fa323b910e645\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.521256 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.521101    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.521256 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.521168    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c54cde61181c8e33c72b5d5e568694e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" (UID: \"0c54cde61181c8e33c72b5d5e568694e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:41.987539 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.987496    5453 apiserver.go:52] "Watching apiserver"
Nov 02 13:43:41.996639 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.996610    5453 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 02 13:43:41.997203 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:41.997181    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7","kube-system/konnectivity-agent-h7znv","openshift-dns/dns-default-8qbcp","openshift-monitoring/prometheus-k8s-0","openshift-multus/multus-additional-cni-plugins-nh9mh","openshift-multus/network-metrics-daemon-6xr2g","openshift-network-diagnostics/network-check-target-zkqr7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal","openshift-insights/insights-runtime-extractor-k6nbb","openshift-image-registry/node-ca-q5f2p","openshift-dns/node-resolver-w8cmr","openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv","openshift-monitoring/node-exporter-4vmlv","kube-system/global-pull-secret-syncer-2lgfl","openshift-multus/multus-8jmp5","kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal","openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c","openshift-network-operator/iptables-alerter-pwcd7","openshift-ovn-kubernetes/ovnkube-node-zpx7n","openshift-cluster-node-tuning-operator/tuned-cwfjf","openshift-ingress-canary/ingress-canary-gfpz8"]
Nov 02 13:43:42.004979 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.004938    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 02 13:43:42.004979 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.004964    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-n56j5\""
Nov 02 13:43:42.006953 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.006925    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.007511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007359    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 02 13:43:42.007511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007431    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 02 13:43:42.007511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007451    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.007511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007479    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.007511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007497    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 02 13:43:42.007846 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007787    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 02 13:43:42.007846 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007818    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cmphd\""
Nov 02 13:43:42.007846 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007830    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007865    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007867    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007899    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007906    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007917    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007945    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007946    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 02 13:43:42.007983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.007977    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.008362 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.008037    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fbcvm\""
Nov 02 13:43:42.008413 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.008376    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.008460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.008449    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 02 13:43:42.008518 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.008502    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 02 13:43:42.008564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.008518    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-tzjbd\""
Nov 02 13:43:42.008564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.008540    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-mlv7f\""
Nov 02 13:43:42.009246 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009220    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cjbpx\""
Nov 02 13:43:42.009246 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009231    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.009396 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009248    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.009396 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009234    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-m5gp5\""
Nov 02 13:43:42.009515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009436    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cfdrs\""
Nov 02 13:43:42.009515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009465    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.009621 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009558    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tb7ws\""
Nov 02 13:43:42.009621 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009560    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.009621 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009576    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 02 13:43:42.009621 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009619    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 02 13:43:42.009758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009652    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s2t6n\""
Nov 02 13:43:42.009758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009688    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.009758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009690    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 02 13:43:42.009758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009750    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rzz2\""
Nov 02 13:43:42.009927 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009906    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.010052 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.009949    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qngrq\""
Nov 02 13:43:42.010052 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.010007    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.010052 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.010050    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 02 13:43:42.010409 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.010396    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-clq6z\""
Nov 02 13:43:42.010460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.010447    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 02 13:43:42.010998 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.010985    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sw4zl\""
Nov 02 13:43:42.011141 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.011127    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 02 13:43:42.012478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.012460    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 02 13:43:42.012561 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.012490    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 02 13:43:42.012805 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.012791    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gnlzz\""
Nov 02 13:43:42.012871 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.012856    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 02 13:43:42.012955 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.012943    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 02 13:43:42.013020 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.013008    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 02 13:43:42.013082 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.013055    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-42t9j\""
Nov 02 13:43:42.013145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.013130    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bwkqn\""
Nov 02 13:43:42.013199 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.013153    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-cw7nr\""
Nov 02 13:43:42.018594 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018572    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 02 13:43:42.018811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018787    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 02 13:43:42.018811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018803    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018807    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018803    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018826    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018825    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018871    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5f49\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018872    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018874    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018886    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018887    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v44xd\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018899    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 02 13:43:42.018987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018954    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95485trdvqe3r\""
Nov 02 13:43:42.019330 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.018999    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 02 13:43:42.022713 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022688    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.022837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022736    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-modprobe-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.022837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022761    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-run\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.022837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022787    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.022837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022791    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.022837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022812    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-hostroot\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022889    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-slash\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022927    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0002f62b-5055-4220-8db5-114709282274-tmp-dir\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022976    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-multus\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.022996    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-log-socket\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023011    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023029    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023038    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0002f62b-5055-4220-8db5-114709282274-tmp-dir\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023045    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-system-cni-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023120    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-registration-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023151    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df7f1d80-b01d-4626-ac19-b055f34313f3-ovn-node-metrics-cert\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.023178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023167    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023189    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-host\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023206    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-tmp\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023223    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023245    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023333    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-tmp\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023346    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-sys-fs\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023382    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-serviceca\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023390    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/df7f1d80-b01d-4626-ac19-b055f34313f3-ovn-node-metrics-cert\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023420    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-root\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023448    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023452    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023467    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-metrics-client-ca\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023510    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b25c973e-ffda-4a4e-b993-a7b497f0101f-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023543    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d8613c-01dc-4cab-873e-543602bf77e8-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023568    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pglfg\" (UniqueName: \"kubernetes.io/projected/42958d29-5904-4838-a53c-09daea08f7ee-kube-api-access-pglfg\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023593    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-multus-certs\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023599    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b25c973e-ffda-4a4e-b993-a7b497f0101f-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023617    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-tuned\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023651    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpgxw\" (UniqueName: \"kubernetes.io/projected/8b1bb6b7-76a7-4770-949d-3a93833e2553-kube-api-access-cpgxw\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023674    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-tmp-dir\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023699    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-sys\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023703    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-tuned\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023727    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-bin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.023751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023759    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-systemd\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023797    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-tmp-dir\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023825    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b84bd6d-f423-4226-81b7-ce29872a76a8-host-slash\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023852    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-dbus\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023872    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e296d175-5e39-47c7-87fb-a11e6df8a494-crio-socket\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023920    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023954    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-conf-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.023989    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024016    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-serviceca\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024019    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b84bd6d-f423-4226-81b7-ce29872a76a8-iptables-alerter-script\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024058    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024105    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-cert\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024204    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024210    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-tls\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024252    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024264    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b84bd6d-f423-4226-81b7-ce29872a76a8-iptables-alerter-script\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024280    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024301    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-cert\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024306    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024312    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024368    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024371    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-host\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024402    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-daemon-config\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024431    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024446    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-tls\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024505    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e296d175-5e39-47c7-87fb-a11e6df8a494-data-volume\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024537    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024562    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-kubelet-config\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024602    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e296d175-5e39-47c7-87fb-a11e6df8a494-data-volume\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024606    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-wtmp\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024623    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-daemon-config\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024649    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-sys\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.024678    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-etc-kubernetes\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025025    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49hcq\" (UniqueName: \"kubernetes.io/projected/f6993051-07c5-4982-ae6f-862d23237028-kube-api-access-49hcq\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025101    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e296d175-5e39-47c7-87fb-a11e6df8a494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025130    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-socket-dir-parent\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025164    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t7mc\" (UniqueName: \"kubernetes.io/projected/df7f1d80-b01d-4626-ac19-b055f34313f3-kube-api-access-2t7mc\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025291    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.025304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025325    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-bin\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025355    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cni-binary-copy\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025380    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-kubelet\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025407    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cnibin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025421    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e296d175-5e39-47c7-87fb-a11e6df8a494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025437    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-env-overrides\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025651    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-env-overrides\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025766    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025784    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025802    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d8613c-01dc-4cab-873e-543602bf77e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025811    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025875    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-hosts-file\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025920    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-system-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.025956    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-systemd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026013    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cni-binary-copy\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026049    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-var-lib-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026392    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-lib-modules\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026435    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-cnibin\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026453    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-systemd-units\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026473    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-netd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026483    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0aacf513-c851-4576-8689-d08f3c0c0ccb-original-pull-secret\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026500    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026538    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026554    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-device-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026584    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0002f62b-5055-4220-8db5-114709282274-metrics-tls\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026745    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026837    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-textfile\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026872    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-netns\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027000    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0002f62b-5055-4220-8db5-114709282274-metrics-tls\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027001    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6993051-07c5-4982-ae6f-862d23237028-cni-binary-copy\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027123    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.026997    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-ovn\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.027331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027183    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-k8s-cni-cncf-io\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027370    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027423    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027488    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqmx\" (UniqueName: \"kubernetes.io/projected/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-kube-api-access-zjqmx\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027522    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z6nv\" (UniqueName: \"kubernetes.io/projected/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-kube-api-access-2z6nv\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027558    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-kubernetes\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027735    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027761    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-textfile\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027804    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lx2\" (UniqueName: \"kubernetes.io/projected/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-kube-api-access-t6lx2\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027898    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.027899    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysconfig\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028115    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59195bdc-66bf-4fe0-80a2-5f3a55add215-konnectivity-ca\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028178    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028260    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028190    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028339    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h792s\" (UniqueName: \"kubernetes.io/projected/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-api-access-h792s\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028405    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028518    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028574    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028601    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-conf\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028634    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-var-lib-kubelet\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028658    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-socket-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028691    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028723    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-script-lib\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028759    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59195bdc-66bf-4fe0-80a2-5f3a55add215-konnectivity-ca\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028758    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028790    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028823    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxkz9\" (UniqueName: \"kubernetes.io/projected/7b84bd6d-f423-4226-81b7-ce29872a76a8-kube-api-access-gxkz9\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028863    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88shs\" (UniqueName: \"kubernetes.io/projected/0002f62b-5055-4220-8db5-114709282274-kube-api-access-88shs\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028946    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028951    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-netns\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.028992    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4qs\" (UniqueName: \"kubernetes.io/projected/00b1feca-1c57-49db-a7a1-effee069ca7d-kube-api-access-pl4qs\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029027    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjnm\" (UniqueName: \"kubernetes.io/projected/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-kube-api-access-2pjnm\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029098    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.029096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029111    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqctg\" (UniqueName: \"kubernetes.io/projected/3cc4a08b-8598-4bc2-851e-8bbd2854245b-kube-api-access-tqctg\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029184    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-kubelet\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029489    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029588    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5w7q\" (UniqueName: \"kubernetes.io/projected/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-api-access-s5w7q\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029626    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0002f62b-5055-4220-8db5-114709282274-config-volume\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029635    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-script-lib\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029653    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59195bdc-66bf-4fe0-80a2-5f3a55add215-agent-certs\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029688    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-node-log\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029836    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwr8g\" (UniqueName: \"kubernetes.io/projected/27d8613c-01dc-4cab-873e-543602bf77e8-kube-api-access-bwr8g\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029890    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0002f62b-5055-4220-8db5-114709282274-config-volume\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029901    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.029945    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-etc-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.030260    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-config\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.030327    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3cc4a08b-8598-4bc2-851e-8bbd2854245b-metrics-certs\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.030409    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59195bdc-66bf-4fe0-80a2-5f3a55add215-agent-certs\") pod \"konnectivity-agent-h7znv\" (UID: \"59195bdc-66bf-4fe0-80a2-5f3a55add215\") " pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.030453    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 02 13:43:42.030808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.030500    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/df7f1d80-b01d-4626-ac19-b055f34313f3-ovnkube-config\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.033814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.033775    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d8613c-01dc-4cab-873e-543602bf77e8-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.033814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.033792    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-metrics-client-ca\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.035148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.035056    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.035148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.035134    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.035317 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.035127    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b25c973e-ffda-4a4e-b993-a7b497f0101f-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.047492 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.047457    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwr8g\" (UniqueName: \"kubernetes.io/projected/27d8613c-01dc-4cab-873e-543602bf77e8-kube-api-access-bwr8g\") pod \"openshift-state-metrics-7bd7489957-j8z7c\" (UID: \"27d8613c-01dc-4cab-873e-543602bf77e8\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-j8z7c"
Nov 02 13:43:42.057570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057467    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t7mc\" (UniqueName: \"kubernetes.io/projected/df7f1d80-b01d-4626-ac19-b055f34313f3-kube-api-access-2t7mc\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.057570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057509    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lx2\" (UniqueName: \"kubernetes.io/projected/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-kube-api-access-t6lx2\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.057570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057515    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pglfg\" (UniqueName: \"kubernetes.io/projected/42958d29-5904-4838-a53c-09daea08f7ee-kube-api-access-pglfg\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.057570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057524    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpgxw\" (UniqueName: \"kubernetes.io/projected/8b1bb6b7-76a7-4770-949d-3a93833e2553-kube-api-access-cpgxw\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.057570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057534    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqmx\" (UniqueName: \"kubernetes.io/projected/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-kube-api-access-zjqmx\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:43:42.058034 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057660    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5w7q\" (UniqueName: \"kubernetes.io/projected/e296d175-5e39-47c7-87fb-a11e6df8a494-kube-api-access-s5w7q\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.058034 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057668    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxkz9\" (UniqueName: \"kubernetes.io/projected/7b84bd6d-f423-4226-81b7-ce29872a76a8-kube-api-access-gxkz9\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:43:42.058034 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.057861    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hcq\" (UniqueName: \"kubernetes.io/projected/f6993051-07c5-4982-ae6f-862d23237028-kube-api-access-49hcq\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.058034 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.058026    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4qs\" (UniqueName: \"kubernetes.io/projected/00b1feca-1c57-49db-a7a1-effee069ca7d-kube-api-access-pl4qs\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.058258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.058237    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcvk\" (UniqueName: \"kubernetes.io/projected/2dae05df-4c95-47be-895b-f711cc6119f4-kube-api-access-kzcvk\") pod \"network-check-target-zkqr7\" (UID: \"2dae05df-4c95-47be-895b-f711cc6119f4\") " pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:42.058316 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.058242    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqctg\" (UniqueName: \"kubernetes.io/projected/3cc4a08b-8598-4bc2-851e-8bbd2854245b-kube-api-access-tqctg\") pod \"network-metrics-daemon-6xr2g\" (UID: \"3cc4a08b-8598-4bc2-851e-8bbd2854245b\") " pod="openshift-multus/network-metrics-daemon-6xr2g"
Nov 02 13:43:42.058360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.058344    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88shs\" (UniqueName: \"kubernetes.io/projected/0002f62b-5055-4220-8db5-114709282274-kube-api-access-88shs\") pod \"dns-default-8qbcp\" (UID: \"0002f62b-5055-4220-8db5-114709282274\") " pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:42.059451 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.059435    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z6nv\" (UniqueName: \"kubernetes.io/projected/b207bcfa-5e2e-4190-ac0b-82a05dca20ec-kube-api-access-2z6nv\") pod \"ingress-canary-gfpz8\" (UID: \"b207bcfa-5e2e-4190-ac0b-82a05dca20ec\") " pod="openshift-ingress-canary/ingress-canary-gfpz8"
Nov 02 13:43:42.061285 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.061266    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjnm\" (UniqueName: \"kubernetes.io/projected/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-kube-api-access-2pjnm\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:43:42.061721 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.061704    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h792s\" (UniqueName: \"kubernetes.io/projected/b25c973e-ffda-4a4e-b993-a7b497f0101f-kube-api-access-h792s\") pod \"kube-state-metrics-5dc8d7d89b-stvt7\" (UID: \"b25c973e-ffda-4a4e-b993-a7b497f0101f\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-stvt7"
Nov 02 13:43:42.098674 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.098636    5453 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:42.098808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.098787    5453 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:42.107421 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.107383    5453 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 02 13:43:42.118158 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.118121    5453 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 13:43:42.118311 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:42.118186    5453 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:42.118641 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.118615    5453 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 02 13:43:42.118750 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:43:42.118658    5453 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.us-east-2.compute.internal"
Nov 02 13:43:42.131374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131341    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-netns\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.131374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131378    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-kubelet\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131403    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc49235c-8639-439b-be7a-a34abd071d49-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131450    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-node-log\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131475    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-etc-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131487    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-kubelet\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131506    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-modprobe-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131490    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-netns\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131522    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-node-log\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131527    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-run\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131579    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-hostroot\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131581    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-run\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131611    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-slash\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131633    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-slash\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131613    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-hostroot\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131638    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-multus\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131634    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-modprobe-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131664    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-log-socket\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131674    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-multus\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131532    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-etc-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131690    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-system-cni-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131728    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-system-cni-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131733    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-registration-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131728    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-log-socket\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131756    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131772    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-host\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131730    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc49235c-8639-439b-be7a-a34abd071d49-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131788    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131827    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-sys-fs\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131846    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-host\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131858    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-registration-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131887    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-sys-fs\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131900    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-d\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131851    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131938    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-root\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.131962 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131968    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131986    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.131991    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp45b\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132022    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-root\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132025    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-multus-certs\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132038    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132048    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-multus-certs\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132057    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-sys\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132107    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-bin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132115    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-sys\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132128    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-systemd\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132144    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b84bd6d-f423-4226-81b7-ce29872a76a8-host-slash\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132155    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-cni-bin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132158    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-dbus\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132198    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132202    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b84bd6d-f423-4226-81b7-ce29872a76a8-host-slash\") pod \"iptables-alerter-pwcd7\" (UID: \"7b84bd6d-f423-4226-81b7-ce29872a76a8\") " pod="openshift-network-operator/iptables-alerter-pwcd7"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132205    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-systemd\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132202    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-dbus\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132227    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e296d175-5e39-47c7-87fb-a11e6df8a494-crio-socket\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132227    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132252    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-conf-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132282    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132285    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e296d175-5e39-47c7-87fb-a11e6df8a494-crio-socket\") pod \"insights-runtime-extractor-k6nbb\" (UID: \"e296d175-5e39-47c7-87fb-a11e6df8a494\") " pod="openshift-insights/insights-runtime-extractor-k6nbb"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132323    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-conf-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132325    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132365    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132376    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132396    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132426    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132442    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-host\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132444    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132466    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132492    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-kubelet-config\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132495    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132504    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cbc0ac-084e-4ded-81bf-51bc0ebdf74c-host\") pod \"node-ca-q5f2p\" (UID: \"11cbc0ac-084e-4ded-81bf-51bc0ebdf74c\") " pod="openshift-image-registry/node-ca-q5f2p"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132515    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-wtmp\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132532    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132541    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-sys\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132550    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0aacf513-c851-4576-8689-d08f3c0c0ccb-kubelet-config\") pod \"global-pull-secret-syncer-2lgfl\" (UID: \"0aacf513-c851-4576-8689-d08f3c0c0ccb\") " pod="kube-system/global-pull-secret-syncer-2lgfl"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132568    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132578    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42958d29-5904-4838-a53c-09daea08f7ee-node-exporter-wtmp\") pod \"node-exporter-4vmlv\" (UID: \"42958d29-5904-4838-a53c-09daea08f7ee\") " pod="openshift-monitoring/node-exporter-4vmlv"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132584    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-sys\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132573    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132593    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-etc-kubernetes\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132617    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132634    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-socket-dir-parent\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132650    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-bin\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132681    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-bin\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132705    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132710    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-etc-kubernetes\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132727    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-kubelet\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132703    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-socket-dir-parent\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132759    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132762    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-var-lib-kubelet\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132788    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132805    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132819    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cnibin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.132808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132846    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-hosts-file\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132871    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132884    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-cnibin\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132897    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132919    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba-hosts-file\") pod \"node-resolver-w8cmr\" (UID: \"09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba\") " pod="openshift-dns/node-resolver-w8cmr"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132922    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-system-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132866    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132964    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-system-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132972    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-systemd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132989    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.132990    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133002    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-var-lib-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133014    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-systemd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133029    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-lib-modules\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133031    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133053    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-var-lib-openvswitch\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133054    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-cnibin\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133108    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-systemd-units\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133116    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6993051-07c5-4982-ae6f-862d23237028-cnibin\") pod \"multus-additional-cni-plugins-nh9mh\" (UID: \"f6993051-07c5-4982-ae6f-862d23237028\") " pod="openshift-multus/multus-additional-cni-plugins-nh9mh"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133125    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-netd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133154    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-lib-modules\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133158    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133181    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-cni-netd\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133160    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-systemd-units\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133185    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133202    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-etc-selinux\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133221    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-device-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133238    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-multus-cni-dir\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133250    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133257    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-device-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133292    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133323    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-netns\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133346    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-ovn\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133371    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133387    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-netns\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133396    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-k8s-cni-cncf-io\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133398    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-run-ovn\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133424    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133449    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133451    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-kubernetes\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133459    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eddfdae8-aa30-4e31-b3f9-2e614f5b3cef-host-run-k8s-cni-cncf-io\") pod \"multus-8jmp5\" (UID: \"eddfdae8-aa30-4e31-b3f9-2e614f5b3cef\") " pod="openshift-multus/multus-8jmp5"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133493    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-kubernetes\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133501    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133564    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133598    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133614    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysconfig\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133632    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133658    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-conf\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133683    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-var-lib-kubelet\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133701    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysconfig\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133708    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-socket-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133713    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df7f1d80-b01d-4626-ac19-b055f34313f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zpx7n\" (UID: \"df7f1d80-b01d-4626-ac19-b055f34313f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133732    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133738    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133767    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-var-lib-kubelet\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133778    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6ngl\" (UniqueName: \"kubernetes.io/projected/cc49235c-8639-439b-be7a-a34abd071d49-kube-api-access-v6ngl\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133773    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133829    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133871    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b1feca-1c57-49db-a7a1-effee069ca7d-etc-sysctl-conf\") pod \"tuned-cwfjf\" (UID: \"00b1feca-1c57-49db-a7a1-effee069ca7d\") " pod="openshift-cluster-node-tuning-operator/tuned-cwfjf"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133898    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b1bb6b7-76a7-4770-949d-3a93833e2553-socket-dir\") pod \"aws-ebs-csi-driver-node-fm2cv\" (UID: \"8b1bb6b7-76a7-4770-949d-3a93833e2553\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fm2cv"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133914    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.133932    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.134602    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.134773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.134605    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.143133 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.143106    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp45b\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\") pod \"prometheus-k8s-0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.144561 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.144540    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6ngl\" (UniqueName: \"kubernetes.io/projected/cc49235c-8639-439b-be7a-a34abd071d49-kube-api-access-v6ngl\") pod \"monitoring-plugin-77f4f76594-pr8zs\" (UID: \"cc49235c-8639-439b-be7a-a34abd071d49\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:42.154570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.154537    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:42.579679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.579571    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.601329 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.601296    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:43:42.682849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.682812    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:42.687550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:42.687448    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pr8zs"
Nov 02 13:43:43.269385 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:43.269352    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:43.409907 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:43.409873    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:44.759195 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:44.759154    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8qbcp"
Nov 02 13:43:46.839948 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:46.839916    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h7znv"
Nov 02 13:43:47.814419 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:47.814384    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:48.264037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:48.263945    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:43:48.264436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:48.264220    5453 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 02 13:43:51.181291 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:51.181203    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:51.371772 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:51.371734    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:51.873787 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:51.873751    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:52.010357 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:52.010323    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:43:52.011169 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:52.011150    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:43:54.144936 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:43:54.144903    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zpx7n"
Nov 02 13:44:06.083410 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:44:06.083370    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:44:09.586298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:09.586238    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:44:09.731239 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:09.731206    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:44:12.014782 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:12.014751    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zkqr7"
Nov 02 13:44:15.044632 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.044596    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:44:15.045177 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.045139    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-web" containerID="cri-o://1d282f60afa77f2364ebbcd5d1a804841ec8856822c2164a93a90b615fb2b2ac" gracePeriod=600
Nov 02 13:44:15.045177 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.045139    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="prometheus" containerID="cri-o://1a419530e20368e1636591e84517c5a2e7f25622fd6755b2ef39a0adf609c06a" gracePeriod=600
Nov 02 13:44:15.045318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.045151    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="thanos-sidecar" containerID="cri-o://85654c3d77d0d1250b96929b95bf5aea2153efb6a5adbee6ff02db9b28a9a538" gracePeriod=600
Nov 02 13:44:15.045318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.045182    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c6baca638a46cf594eafae6f4f22a9e7c7cf0373f5829f298eaef52bac8defff" gracePeriod=600
Nov 02 13:44:15.045318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.045191    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="config-reloader" containerID="cri-o://3505df248a65187e22b990ebebc60defc35444023505cfc8c31b597812577c90" gracePeriod=600
Nov 02 13:44:15.045318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.045188    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy" containerID="cri-o://ce16f5c5c516a5594b8e95c818acd2cd93e9201ec03eaf2d4f2f651414435d73" gracePeriod=600
Nov 02 13:44:15.218778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218738    5453 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="c6baca638a46cf594eafae6f4f22a9e7c7cf0373f5829f298eaef52bac8defff" exitCode=0
Nov 02 13:44:15.218778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218762    5453 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="ce16f5c5c516a5594b8e95c818acd2cd93e9201ec03eaf2d4f2f651414435d73" exitCode=0
Nov 02 13:44:15.218778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218768    5453 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="1d282f60afa77f2364ebbcd5d1a804841ec8856822c2164a93a90b615fb2b2ac" exitCode=0
Nov 02 13:44:15.218778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218773    5453 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="85654c3d77d0d1250b96929b95bf5aea2153efb6a5adbee6ff02db9b28a9a538" exitCode=0
Nov 02 13:44:15.218778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218779    5453 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="3505df248a65187e22b990ebebc60defc35444023505cfc8c31b597812577c90" exitCode=0
Nov 02 13:44:15.218778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218787    5453 generic.go:356] "Generic (PLEG): container finished" podID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerID="1a419530e20368e1636591e84517c5a2e7f25622fd6755b2ef39a0adf609c06a" exitCode=0
Nov 02 13:44:15.219228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218804    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"c6baca638a46cf594eafae6f4f22a9e7c7cf0373f5829f298eaef52bac8defff"}
Nov 02 13:44:15.219228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218869    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"ce16f5c5c516a5594b8e95c818acd2cd93e9201ec03eaf2d4f2f651414435d73"}
Nov 02 13:44:15.219228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218894    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"1d282f60afa77f2364ebbcd5d1a804841ec8856822c2164a93a90b615fb2b2ac"}
Nov 02 13:44:15.219228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218918    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"85654c3d77d0d1250b96929b95bf5aea2153efb6a5adbee6ff02db9b28a9a538"}
Nov 02 13:44:15.219228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218940    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"3505df248a65187e22b990ebebc60defc35444023505cfc8c31b597812577c90"}
Nov 02 13:44:15.219228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.218961    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"1a419530e20368e1636591e84517c5a2e7f25622fd6755b2ef39a0adf609c06a"}
Nov 02 13:44:15.299283 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.299205    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:15.401603 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401559    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.401797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401611    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.401797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401670    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.401797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401718    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.401797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401748    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.401797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401783    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401809    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401837    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401872    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401905    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401938    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.401966    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.402027    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.402063    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.402083    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:44:15.402448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.402116    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.402448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.402368    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:44:15.402729 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.402687    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:44:15.403174 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.403140    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.403303 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.403197    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.403303 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.403236    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.403303 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.403267    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.403546 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.403300    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\") pod \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\" (UID: \"871026e6-bd87-4ba4-90c2-f87b2be0fdc0\") "
Nov 02 13:44:15.403847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.403802    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:44:15.404909 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.404374    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:44:15.404909 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.404606    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:44:15.405136 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.405122    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:44:15.405241 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.405220    5453 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-metrics-client-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.405286 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.405248    5453 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-db\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.405286 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.405267    5453 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.405369 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.405284    5453 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.405645 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.405622    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:44:15.406934 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.406905    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.407198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.407161    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.407299 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.407191    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:44:15.407545 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.407503    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.407632 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.407591    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.407935 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.407915    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:44:15.408368 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.408337    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.408467 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.408435    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.408518 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.408501    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "kube-api-access-vp45b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:44:15.408666 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.408650    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.409660 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.409640    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.417752 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.417719    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config" pod "871026e6-bd87-4ba4-90c2-f87b2be0fdc0" (UID: "871026e6-bd87-4ba4-90c2-f87b2be0fdc0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:44:15.505961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.505921    5453 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-kube-rbac-proxy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.505961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.505951    5453 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.505961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.505962    5453 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-web-config\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.505961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.505971    5453 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.505979    5453 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.505990    5453 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.505999    5453 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-metrics-client-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506008    5453 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506019    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp45b\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-kube-api-access-vp45b\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506027    5453 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506037    5453 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506048    5453 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-config-out\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506058    5453 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506092    5453 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-secret-grpc-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506105    5453 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:15.506248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:15.506118    5453 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871026e6-bd87-4ba4-90c2-f87b2be0fdc0-tls-assets\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:44:16.225360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.225323    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"871026e6-bd87-4ba4-90c2-f87b2be0fdc0","Type":"ContainerDied","Data":"ffe838a8fc70213dacf09a7cbaedea321106f2efe06209f7ee687cdf7af3f78f"}
Nov 02 13:44:16.225849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.225424    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.225849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.225437    5453 scope.go:122] "RemoveContainer" containerID="c6baca638a46cf594eafae6f4f22a9e7c7cf0373f5829f298eaef52bac8defff"
Nov 02 13:44:16.234035 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.234010    5453 scope.go:122] "RemoveContainer" containerID="ce16f5c5c516a5594b8e95c818acd2cd93e9201ec03eaf2d4f2f651414435d73"
Nov 02 13:44:16.241657 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.241638    5453 scope.go:122] "RemoveContainer" containerID="1d282f60afa77f2364ebbcd5d1a804841ec8856822c2164a93a90b615fb2b2ac"
Nov 02 13:44:16.249000 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.248979    5453 scope.go:122] "RemoveContainer" containerID="85654c3d77d0d1250b96929b95bf5aea2153efb6a5adbee6ff02db9b28a9a538"
Nov 02 13:44:16.254263 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.254238    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:44:16.257316 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.257293    5453 scope.go:122] "RemoveContainer" containerID="3505df248a65187e22b990ebebc60defc35444023505cfc8c31b597812577c90"
Nov 02 13:44:16.259834 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.259808    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:44:16.265140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.265119    5453 scope.go:122] "RemoveContainer" containerID="1a419530e20368e1636591e84517c5a2e7f25622fd6755b2ef39a0adf609c06a"
Nov 02 13:44:16.273273 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.273251    5453 scope.go:122] "RemoveContainer" containerID="0fbc15eb18190c0abeecf486e20e330081082edbfdf34add5499dfa7a6fbf21f"
Nov 02 13:44:16.293575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293546    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:44:16.293798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293786    5453 cpu_manager.go:414] "containerMap: removing container" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="prometheus"
Nov 02 13:44:16.293847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293800    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="prometheus"
Nov 02 13:44:16.293847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293814    5453 cpu_manager.go:414] "containerMap: removing container" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-web"
Nov 02 13:44:16.293847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293819    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-web"
Nov 02 13:44:16.293847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293830    5453 cpu_manager.go:414] "containerMap: removing container" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="init-config-reloader"
Nov 02 13:44:16.293847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293837    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="init-config-reloader"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293863    5453 cpu_manager.go:414] "containerMap: removing container" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293871    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293889    5453 cpu_manager.go:414] "containerMap: removing container" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="thanos-sidecar"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293895    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="thanos-sidecar"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293901    5453 cpu_manager.go:414] "containerMap: removing container" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="config-reloader"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293906    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="config-reloader"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293915    5453 cpu_manager.go:414] "containerMap: removing container" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-thanos"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293919    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-thanos"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293965    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293972    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="thanos-sidecar"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293977    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="config-reloader"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293982    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-thanos"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293987    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="prometheus"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.293996    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="kube-rbac-proxy-web"
Nov 02 13:44:16.294030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.294004    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" containerName="init-config-reloader"
Nov 02 13:44:16.296681 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.296660    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.304822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.304785    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 02 13:44:16.304973 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.304831    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5f49\""
Nov 02 13:44:16.304973 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.304884    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 02 13:44:16.304973 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.304910    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 02 13:44:16.305158 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305141    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 02 13:44:16.305241 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305159    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 02 13:44:16.305241 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305213    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 02 13:44:16.305347 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305241    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 02 13:44:16.305347 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305266    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95485trdvqe3r\""
Nov 02 13:44:16.305347 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305287    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 02 13:44:16.306004 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305981    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 02 13:44:16.306004 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.305990    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 02 13:44:16.306303 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.306013    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 02 13:44:16.306303 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.306009    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 02 13:44:16.306303 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.306047    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 02 13:44:16.311257 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.311189    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 02 13:44:16.311377 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.311325    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 02 13:44:16.318366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.318338    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:44:16.411800 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.411761    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-config\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.411800 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.411795    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.411818    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.411899    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.411963    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.411986    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e4bee65-de10-48f5-94d4-cb2738d379f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412045    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412301 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412139    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412301 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412163    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412301 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412185    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412301 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412226    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412301 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412290    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e4bee65-de10-48f5-94d4-cb2738d379f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412487 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412312    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412487 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412327    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412487 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412347    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412487 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412391    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412487 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412421    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412487 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412468    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412490    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.412678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.412508    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm8m2\" (UniqueName: \"kubernetes.io/projected/3e4bee65-de10-48f5-94d4-cb2738d379f4-kube-api-access-pm8m2\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.512896 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.512854    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.512896 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.512897    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.512896 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.512918    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513233 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.512934    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513233 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513132    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e4bee65-de10-48f5-94d4-cb2738d379f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513233 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513192    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513233 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513221    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513249    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513274    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513307    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513336    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513368    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513397    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8m2\" (UniqueName: \"kubernetes.io/projected/3e4bee65-de10-48f5-94d4-cb2738d379f4-kube-api-access-pm8m2\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513406    5453 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513448    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-config\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513474    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513500    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513549    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513594    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513624    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e4bee65-de10-48f5-94d4-cb2738d379f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513651    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.513756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513701    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.514179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513763    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.514179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513825    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.514179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513977    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.514179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.513990    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.514549 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.514360    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.516167 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.516100    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.516948 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.516902    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e4bee65-de10-48f5-94d4-cb2738d379f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.517517 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.517488    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.517689 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.517668    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.517778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.517757    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.518092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.518037    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e4bee65-de10-48f5-94d4-cb2738d379f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.518410 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.518378    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.518675 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.518652    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-config\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.519190 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.519171    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.519976 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.519948    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.520186 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.520163    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e4bee65-de10-48f5-94d4-cb2738d379f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.520264 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.520213    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.520622 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.520598    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e4bee65-de10-48f5-94d4-cb2738d379f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.529727 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.529691    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm8m2\" (UniqueName: \"kubernetes.io/projected/3e4bee65-de10-48f5-94d4-cb2738d379f4-kube-api-access-pm8m2\") pod \"prometheus-k8s-0\" (UID: \"3e4bee65-de10-48f5-94d4-cb2738d379f4\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.614265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.614175    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:16.911934 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:16.911829    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 02 13:44:16.920594 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:44:16.920553    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4bee65_de10_48f5_94d4_cb2738d379f4.slice/crio-e5e8293e5d342eb10adbd3b2f4827a89f5f22c040303d620e80f42708d875983 WatchSource:0}: Error finding container e5e8293e5d342eb10adbd3b2f4827a89f5f22c040303d620e80f42708d875983: Status 404 returned error can't find the container with id e5e8293e5d342eb10adbd3b2f4827a89f5f22c040303d620e80f42708d875983
Nov 02 13:44:17.040682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:17.040643    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="871026e6-bd87-4ba4-90c2-f87b2be0fdc0" path="/var/lib/kubelet/pods/871026e6-bd87-4ba4-90c2-f87b2be0fdc0/volumes"
Nov 02 13:44:17.232522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:17.232435    5453 generic.go:356] "Generic (PLEG): container finished" podID="3e4bee65-de10-48f5-94d4-cb2738d379f4" containerID="44693c44581041fb8cadf6fdd65a928005403967721e83233d71ec1d0ad2567e" exitCode=0
Nov 02 13:44:17.232522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:17.232486    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerDied","Data":"44693c44581041fb8cadf6fdd65a928005403967721e83233d71ec1d0ad2567e"}
Nov 02 13:44:17.232915 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:17.232539    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerStarted","Data":"e5e8293e5d342eb10adbd3b2f4827a89f5f22c040303d620e80f42708d875983"}
Nov 02 13:44:18.001804 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.001765    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:44:18.136812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.136779    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:44:18.240601 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.240565    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerStarted","Data":"2f87963495cc2a1994e33cf9ffeb9b47705afd3d6f3fa9a787ef99a2e1ec47a9"}
Nov 02 13:44:18.240992 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.240649    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerStarted","Data":"b181245e5454ef2b0d88e0de0c0303e19fddc36a412587154bd1a9bbe467afb2"}
Nov 02 13:44:18.240992 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.240688    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerStarted","Data":"d0c394bab87ad54b1d67873dff57c179f2f278efbd6896d8ba23efc2ff17d3b3"}
Nov 02 13:44:18.240992 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.240753    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerStarted","Data":"b35a1cc32b71129dd37d20f65e4698c2ea46799a39672fe95f54e85dceaeae3c"}
Nov 02 13:44:18.240992 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.240791    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerStarted","Data":"a1f58fc9b08a05018f41206c7b75f45fac8e234383ba702a51ba81c985646ac5"}
Nov 02 13:44:18.240992 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.240823    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e4bee65-de10-48f5-94d4-cb2738d379f4","Type":"ContainerStarted","Data":"f5756f94287b3bf29573c43d7b85c1ff07d2237c4937148bc29aba77aad2ed36"}
Nov 02 13:44:18.284861 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.284808    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.257961324 podStartE2EDuration="2.284792882s" totalImagesPullingTime="0s" totalInitContainerRuntime="26.831558ms" isStatefulPod=false podCreationTimestamp="2026-11-02 13:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:44:18.283533016 +0000 UTC m=+37.364685648" watchObservedRunningTime="2026-11-02 13:44:18.284792882 +0000 UTC m=+37.365937998"
Nov 02 13:44:18.351964 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.351927    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:44:18.487384 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:18.487349    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:44:21.614753 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:21.614708    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:44:36.082274 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:44:36.082236    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:44:51.241204 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:51.241169    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:44:58.648728 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:44:58.648652    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:06.083865 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:45:06.083827    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:45:11.224141 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:11.224102    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:45:11.241371 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:11.241344    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:45:11.446950 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:11.446916    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 02 13:45:14.911571 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:14.911532    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:15.070702 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:15.070666    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:15.787987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:15.787923    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:15.918042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:15.918010    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:16.167175 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:16.167090    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:16.302647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:16.302615    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:27.602365 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:27.602314    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:27.748662 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:27.748616    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:36.083136 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:45:36.083086    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:45:36.883907 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:36.883759    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:37.019007 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:37.018976    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:45.429263 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:45.429229    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:45.564446 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:45.564406    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:45:51.287847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:45:51.287811    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:46:06.082366 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:46:06.082316    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:46:18.527122 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:46:18.527085    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:46:18.697512 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:46:18.697474    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:46:36.083110 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:46:36.083046    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:46:51.359921 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:46:51.359823    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:46:59.887238 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:46:59.887198    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:00.999097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:00.999045    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:06.081905 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:47:06.081866    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:47:30.468395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:30.468358    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:36.082858 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:47:36.082818    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:47:44.376848 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:44.376815    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:45.826173 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:45.826138    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:45.956259 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:45.956227    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:51.403934 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:51.403875    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:53.343511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:53.343456    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:53.503867 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:53.503822    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:53.773744 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:53.773651    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:53.970735 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:53.970702    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:55.604846 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.604811    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:55.653495 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.653462    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"]
Nov 02 13:47:55.656952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.656926    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.673374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.673347    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 02 13:47:55.679257 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.679233    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 02 13:47:55.681617 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.681592    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"]
Nov 02 13:47:55.682582 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.682563    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-j4mfz\""
Nov 02 13:47:55.692713 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.692682    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"]
Nov 02 13:47:55.696224 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.696197    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.713735 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.713702    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"]
Nov 02 13:47:55.755851 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.755817    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:55.779363 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.779330    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.779445 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.779371    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-kube-api-access-zvlpl\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.779445 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.779403    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.779533 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.779512    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.779586 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.779572    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csn6l\" (UniqueName: \"kubernetes.io/projected/e069c24d-c19d-446c-b272-f0724b1800fc-kube-api-access-csn6l\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.779640 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.779628    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.779967 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.779953    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-xsk6f\""
Nov 02 13:47:55.880577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.880506    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.880577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.880562    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csn6l\" (UniqueName: \"kubernetes.io/projected/e069c24d-c19d-446c-b272-f0724b1800fc-kube-api-access-csn6l\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.880693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.880586    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.880693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.880611    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.880693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.880629    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-kube-api-access-zvlpl\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.880693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.880652    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.881041 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.881019    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.881140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.881051    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.881140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.881021    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.881140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.881096    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.893731 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.893705    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csn6l\" (UniqueName: \"kubernetes.io/projected/e069c24d-c19d-446c-b272-f0724b1800fc-kube-api-access-csn6l\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:55.898800 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.898778    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-kube-api-access-zvlpl\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:55.972444 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:55.972395    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:47:56.015046 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.015014    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:47:56.141152 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.141059    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"]
Nov 02 13:47:56.149603 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.149571    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.160795 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.160762    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-xcpnq\""
Nov 02 13:47:56.160948 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.160933    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"]
Nov 02 13:47:56.253044 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.253010    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"]
Nov 02 13:47:56.256736 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:47:56.256711    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a7bde7_305c_4c2c_bcc5_c48afae4f5aa.slice/crio-af9540921ddd7320e7900351fc1c3fa245546b0aeb02a65909396e3e847627af WatchSource:0}: Error finding container af9540921ddd7320e7900351fc1c3fa245546b0aeb02a65909396e3e847627af: Status 404 returned error can't find the container with id af9540921ddd7320e7900351fc1c3fa245546b0aeb02a65909396e3e847627af
Nov 02 13:47:56.258677 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.258660    5453 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 13:47:56.285884 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.285849    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.286083 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.285901    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrq4f\" (UniqueName: \"kubernetes.io/projected/727d3758-3eb1-4f06-8666-f82c4fe40608-kube-api-access-hrq4f\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.286148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.286062    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.304670 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.304638    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"]
Nov 02 13:47:56.308120 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:47:56.308091    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode069c24d_c19d_446c_b272_f0724b1800fc.slice/crio-cfd0609ec63f91e7f2b708b6fceb866049bfb630241a6f70d423c8dc779847e7 WatchSource:0}: Error finding container cfd0609ec63f91e7f2b708b6fceb866049bfb630241a6f70d423c8dc779847e7: Status 404 returned error can't find the container with id cfd0609ec63f91e7f2b708b6fceb866049bfb630241a6f70d423c8dc779847e7
Nov 02 13:47:56.386662 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.386625    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.386821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.386670    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.386821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.386705    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrq4f\" (UniqueName: \"kubernetes.io/projected/727d3758-3eb1-4f06-8666-f82c4fe40608-kube-api-access-hrq4f\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.387170 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.387139    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.387170 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.387147    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.400618 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.400542    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrq4f\" (UniqueName: \"kubernetes.io/projected/727d3758-3eb1-4f06-8666-f82c4fe40608-kube-api-access-hrq4f\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.465912 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.465876    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:47:56.742221 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.742133    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"]
Nov 02 13:47:56.745914 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:47:56.745881    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727d3758_3eb1_4f06_8666_f82c4fe40608.slice/crio-c622594ff50850943b4c697832be89179be8ce5f807832ab9975fb077a773447 WatchSource:0}: Error finding container c622594ff50850943b4c697832be89179be8ce5f807832ab9975fb077a773447: Status 404 returned error can't find the container with id c622594ff50850943b4c697832be89179be8ce5f807832ab9975fb077a773447
Nov 02 13:47:56.987446 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.987400    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj" event={"ID":"e069c24d-c19d-446c-b272-f0724b1800fc","Type":"ContainerStarted","Data":"cfd0609ec63f91e7f2b708b6fceb866049bfb630241a6f70d423c8dc779847e7"}
Nov 02 13:47:56.989782 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.989691    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq" event={"ID":"727d3758-3eb1-4f06-8666-f82c4fe40608","Type":"ContainerStarted","Data":"c622594ff50850943b4c697832be89179be8ce5f807832ab9975fb077a773447"}
Nov 02 13:47:56.991118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:56.991089    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn" event={"ID":"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa","Type":"ContainerStarted","Data":"af9540921ddd7320e7900351fc1c3fa245546b0aeb02a65909396e3e847627af"}
Nov 02 13:47:57.089993 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:57.089946    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:47:59.766113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.766062    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"]
Nov 02 13:47:59.770268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.769735    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:47:59.786734 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.786709    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-6m4xm\""
Nov 02 13:47:59.798412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.798361    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"]
Nov 02 13:47:59.866432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.866379    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"]
Nov 02 13:47:59.870369 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.870337    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:47:59.874178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.874130    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-9wv7k\""
Nov 02 13:47:59.882297 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.882236    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"]
Nov 02 13:47:59.917127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.917063    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:47:59.917334 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.917143    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7nf9\" (UniqueName: \"kubernetes.io/projected/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-kube-api-access-q7nf9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:47:59.917404 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.917339    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:47:59.966358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.966320    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"]
Nov 02 13:47:59.971532 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.971428    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:47:59.979613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.978796    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-8zswb\""
Nov 02 13:47:59.979613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:47:59.979302    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"]
Nov 02 13:48:00.018461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018223    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.018461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018320    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-462fl\" (UniqueName: \"kubernetes.io/projected/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-kube-api-access-462fl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.018461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018428    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:00.018833 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018470    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7nf9\" (UniqueName: \"kubernetes.io/projected/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-kube-api-access-q7nf9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:00.018833 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018541    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.018833 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018584    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:00.019014 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018915    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:00.019014 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.018990    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:00.033326 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.033259    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7nf9\" (UniqueName: \"kubernetes.io/projected/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-kube-api-access-q7nf9\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:00.066053 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.066012    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"]
Nov 02 13:48:00.070104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.070053    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.079531 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.079486    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-gmfv5\""
Nov 02 13:48:00.084201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.084145    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"]
Nov 02 13:48:00.088798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.088771    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:00.119540 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.119481    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.119985 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.119942    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.120255 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.120236    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-462fl\" (UniqueName: \"kubernetes.io/projected/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-kube-api-access-462fl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.120528 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.120481    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.120755 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.120250    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.120836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.120720    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ww46\" (UniqueName: \"kubernetes.io/projected/667852f5-500f-406e-a648-2590caaeef64-kube-api-access-2ww46\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.121108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.120994    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.121272 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.121252    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.138661 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.138521    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-462fl\" (UniqueName: \"kubernetes.io/projected/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-kube-api-access-462fl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.192268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.191963    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.222798    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.222851    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.222896    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcgvx\" (UniqueName: \"kubernetes.io/projected/1f50bcbd-6f49-4cd0-9680-eca71a777fda-kube-api-access-lcgvx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.222937    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ww46\" (UniqueName: \"kubernetes.io/projected/667852f5-500f-406e-a648-2590caaeef64-kube-api-access-2ww46\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.222966    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.223039    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.223592    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.224394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.224287    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.238119 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.238031    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ww46\" (UniqueName: \"kubernetes.io/projected/667852f5-500f-406e-a648-2590caaeef64-kube-api-access-2ww46\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.296942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.296497    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:00.324208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.324150    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.324428 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.324256    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.324428 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.324300    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcgvx\" (UniqueName: \"kubernetes.io/projected/1f50bcbd-6f49-4cd0-9680-eca71a777fda-kube-api-access-lcgvx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.325136 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.325115    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.325356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.325340    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.338609 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.338578    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcgvx\" (UniqueName: \"kubernetes.io/projected/1f50bcbd-6f49-4cd0-9680-eca71a777fda-kube-api-access-lcgvx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.393765 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.393477    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:00.410456 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.410201    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"]
Nov 02 13:48:00.417939 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:48:00.417889    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e84fdb_797b_4ceb_8f51_8acabb6b90c3.slice/crio-4ec710569dbcfbc5ede6f52b0e8447abc02f7eb61c87493e580de436c23be102 WatchSource:0}: Error finding container 4ec710569dbcfbc5ede6f52b0e8447abc02f7eb61c87493e580de436c23be102: Status 404 returned error can't find the container with id 4ec710569dbcfbc5ede6f52b0e8447abc02f7eb61c87493e580de436c23be102
Nov 02 13:48:00.493401 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.493318    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"]
Nov 02 13:48:00.626022 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.625929    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"]
Nov 02 13:48:00.644546 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:48:00.644511    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667852f5_500f_406e_a648_2590caaeef64.slice/crio-734abe8687573dd07d4bcb616e36cd5649f88d9274590739a78331690bd3ea40 WatchSource:0}: Error finding container 734abe8687573dd07d4bcb616e36cd5649f88d9274590739a78331690bd3ea40: Status 404 returned error can't find the container with id 734abe8687573dd07d4bcb616e36cd5649f88d9274590739a78331690bd3ea40
Nov 02 13:48:00.702965 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.702928    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"]
Nov 02 13:48:00.707956 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:48:00.707906    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f50bcbd_6f49_4cd0_9680_eca71a777fda.slice/crio-c4de91f9a8d6b2f4ee2002c908459884b4722f6518f96057956a0b6c49b5b345 WatchSource:0}: Error finding container c4de91f9a8d6b2f4ee2002c908459884b4722f6518f96057956a0b6c49b5b345: Status 404 returned error can't find the container with id c4de91f9a8d6b2f4ee2002c908459884b4722f6518f96057956a0b6c49b5b345
Nov 02 13:48:00.751589 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.751547    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:00.813960 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.813922    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"]
Nov 02 13:48:00.819583 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.819551    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:00.833601 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.831733    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"]
Nov 02 13:48:00.930107 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.929998    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:00.930287 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.930151    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vj5x\" (UniqueName: \"kubernetes.io/projected/8a4aebd0-2723-4cff-8df9-8f56125f85e4-kube-api-access-5vj5x\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:00.930287 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.930235    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:00.930832 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:00.930804    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:01.015312 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.015269    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s" event={"ID":"1f50bcbd-6f49-4cd0-9680-eca71a777fda","Type":"ContainerStarted","Data":"c4de91f9a8d6b2f4ee2002c908459884b4722f6518f96057956a0b6c49b5b345"}
Nov 02 13:48:01.017435 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.017400    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh" event={"ID":"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b","Type":"ContainerStarted","Data":"4748d759e07ed06a6ad96f7a86051f40c36a106d760165cae54b47f04401fd11"}
Nov 02 13:48:01.019297 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.019218    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd" event={"ID":"667852f5-500f-406e-a648-2590caaeef64","Type":"ContainerStarted","Data":"734abe8687573dd07d4bcb616e36cd5649f88d9274590739a78331690bd3ea40"}
Nov 02 13:48:01.020957 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.020911    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm" event={"ID":"05e84fdb-797b-4ceb-8f51-8acabb6b90c3","Type":"ContainerStarted","Data":"4ec710569dbcfbc5ede6f52b0e8447abc02f7eb61c87493e580de436c23be102"}
Nov 02 13:48:01.031675 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.031583    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:01.031675 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.031648    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vj5x\" (UniqueName: \"kubernetes.io/projected/8a4aebd0-2723-4cff-8df9-8f56125f85e4-kube-api-access-5vj5x\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:01.031932 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.031711    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:01.032258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.032233    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:01.032511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.032493    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:01.045917 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.045855    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vj5x\" (UniqueName: \"kubernetes.io/projected/8a4aebd0-2723-4cff-8df9-8f56125f85e4-kube-api-access-5vj5x\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:01.147551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.147260    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:01.500601 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.500420    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"]
Nov 02 13:48:01.505583 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:48:01.505549    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4aebd0_2723_4cff_8df9_8f56125f85e4.slice/crio-4cbee6cd41a336b933d403d5c43470be24652d86f2b5f0b927df513fa5ab2c03 WatchSource:0}: Error finding container 4cbee6cd41a336b933d403d5c43470be24652d86f2b5f0b927df513fa5ab2c03: Status 404 returned error can't find the container with id 4cbee6cd41a336b933d403d5c43470be24652d86f2b5f0b927df513fa5ab2c03
Nov 02 13:48:01.977407 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:01.977317    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:02.031581 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.031500    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc" event={"ID":"8a4aebd0-2723-4cff-8df9-8f56125f85e4","Type":"ContainerStarted","Data":"4cbee6cd41a336b933d403d5c43470be24652d86f2b5f0b927df513fa5ab2c03"}
Nov 02 13:48:02.114679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.114632    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:02.168268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.168223    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"]
Nov 02 13:48:02.174273 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.174241    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"]
Nov 02 13:48:02.174474 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.174387    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.245878 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.245704    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.245878 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.245792    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.246163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.245941    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckdn\" (UniqueName: \"kubernetes.io/projected/a4bfa603-5e84-4673-b367-8ab31c9ed353-kube-api-access-9ckdn\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.348122 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.346950    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.348122 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.347029    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckdn\" (UniqueName: \"kubernetes.io/projected/a4bfa603-5e84-4673-b367-8ab31c9ed353-kube-api-access-9ckdn\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.348122 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.347114    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.348122 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.347632    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.348122 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.347878    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.362725 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.362611    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckdn\" (UniqueName: \"kubernetes.io/projected/a4bfa603-5e84-4673-b367-8ab31c9ed353-kube-api-access-9ckdn\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.511606 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.511311    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:02.834140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:02.834061    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"]
Nov 02 13:48:03.050357 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:03.050317    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt" event={"ID":"a4bfa603-5e84-4673-b367-8ab31c9ed353","Type":"ContainerStarted","Data":"d916df9c0f36299ee766d15314d225b3ea19813873ae58dfe9cea9ac51e9b898"}
Nov 02 13:48:04.732381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:04.732223    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:06.139111 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:48:06.139049    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:48:10.109436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:10.107948    5453 generic.go:356] "Generic (PLEG): container finished" podID="e069c24d-c19d-446c-b272-f0724b1800fc" containerID="7805094a9c478ae1dfd4a9531325e483f1eb9164e07e59567eb98a7236ed380c" exitCode=0
Nov 02 13:48:10.109436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:10.108059    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj" event={"ID":"e069c24d-c19d-446c-b272-f0724b1800fc","Type":"ContainerDied","Data":"7805094a9c478ae1dfd4a9531325e483f1eb9164e07e59567eb98a7236ed380c"}
Nov 02 13:48:10.114037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:10.113142    5453 generic.go:356] "Generic (PLEG): container finished" podID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerID="962f58ab65a3d08f4db2cd2ca3b1b695f9e1120cd287ecfcb65b0300b052c990" exitCode=0
Nov 02 13:48:10.114037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:10.113213    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn" event={"ID":"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa","Type":"ContainerDied","Data":"962f58ab65a3d08f4db2cd2ca3b1b695f9e1120cd287ecfcb65b0300b052c990"}
Nov 02 13:48:11.120035 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:11.119995    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm" event={"ID":"05e84fdb-797b-4ceb-8f51-8acabb6b90c3","Type":"ContainerStarted","Data":"1743a2e3c30b981dfd32470a75e84e0e353efe401d5c5f491de36667dab716de"}
Nov 02 13:48:11.122730 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:11.122690    5453 generic.go:356] "Generic (PLEG): container finished" podID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerID="3a0e52f9d53a18f670b1609191f7da09fb467ad5ace4c311b4b5ff63cd89778d" exitCode=0
Nov 02 13:48:11.122900 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:11.122811    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq" event={"ID":"727d3758-3eb1-4f06-8666-f82c4fe40608","Type":"ContainerDied","Data":"3a0e52f9d53a18f670b1609191f7da09fb467ad5ace4c311b4b5ff63cd89778d"}
Nov 02 13:48:11.126272 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:11.126243    5453 generic.go:356] "Generic (PLEG): container finished" podID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerID="cbfa788b06b7d1db3a23ba6db2c683ebcf81089308439d6d709db4c6b92aed3a" exitCode=0
Nov 02 13:48:11.126400 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:11.126305    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh" event={"ID":"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b","Type":"ContainerDied","Data":"cbfa788b06b7d1db3a23ba6db2c683ebcf81089308439d6d709db4c6b92aed3a"}
Nov 02 13:48:11.914746 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:48:11.914712    5453 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667852f5_500f_406e_a648_2590caaeef64.slice/crio-b9e34abb0c33bf6c4b6c05db308c74a423584f5da09d8bea62cde4be6f0a151d.scope\": RecentStats: unable to find data in memory cache]"
Nov 02 13:48:12.132781 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.132743    5453 generic.go:356] "Generic (PLEG): container finished" podID="e069c24d-c19d-446c-b272-f0724b1800fc" containerID="9f4dfab489e56aacaacb5e7237462534fcd669c0c4686ba1e8bf758542d33f2d" exitCode=0
Nov 02 13:48:12.133268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.132833    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj" event={"ID":"e069c24d-c19d-446c-b272-f0724b1800fc","Type":"ContainerDied","Data":"9f4dfab489e56aacaacb5e7237462534fcd669c0c4686ba1e8bf758542d33f2d"}
Nov 02 13:48:12.134453 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.134431    5453 generic.go:356] "Generic (PLEG): container finished" podID="667852f5-500f-406e-a648-2590caaeef64" containerID="b9e34abb0c33bf6c4b6c05db308c74a423584f5da09d8bea62cde4be6f0a151d" exitCode=0
Nov 02 13:48:12.134544 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.134512    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd" event={"ID":"667852f5-500f-406e-a648-2590caaeef64","Type":"ContainerDied","Data":"b9e34abb0c33bf6c4b6c05db308c74a423584f5da09d8bea62cde4be6f0a151d"}
Nov 02 13:48:12.136638 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.136608    5453 generic.go:356] "Generic (PLEG): container finished" podID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerID="1743a2e3c30b981dfd32470a75e84e0e353efe401d5c5f491de36667dab716de" exitCode=0
Nov 02 13:48:12.136788 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.136768    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm" event={"ID":"05e84fdb-797b-4ceb-8f51-8acabb6b90c3","Type":"ContainerDied","Data":"1743a2e3c30b981dfd32470a75e84e0e353efe401d5c5f491de36667dab716de"}
Nov 02 13:48:12.139537 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.139512    5453 generic.go:356] "Generic (PLEG): container finished" podID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerID="6fa701067493d6f22a77b062dd70143e071f2feed8d9a5bb153d231be4dcf346" exitCode=0
Nov 02 13:48:12.139660 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:12.139551    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc" event={"ID":"8a4aebd0-2723-4cff-8df9-8f56125f85e4","Type":"ContainerDied","Data":"6fa701067493d6f22a77b062dd70143e071f2feed8d9a5bb153d231be4dcf346"}
Nov 02 13:48:13.148156 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:13.148102    5453 generic.go:356] "Generic (PLEG): container finished" podID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerID="cae4b32e38d33e1df105f75960e2711839f5312561471a67e24fe9592fa1a491" exitCode=0
Nov 02 13:48:13.148663 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:13.148511    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s" event={"ID":"1f50bcbd-6f49-4cd0-9680-eca71a777fda","Type":"ContainerDied","Data":"cae4b32e38d33e1df105f75960e2711839f5312561471a67e24fe9592fa1a491"}
Nov 02 13:48:13.152134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:13.151924    5453 generic.go:356] "Generic (PLEG): container finished" podID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerID="6a0603ca81854c5299285723a2dd9630d4985ad981b727a5d441e5a41872ac0e" exitCode=0
Nov 02 13:48:13.152134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:13.151989    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt" event={"ID":"a4bfa603-5e84-4673-b367-8ab31c9ed353","Type":"ContainerDied","Data":"6a0603ca81854c5299285723a2dd9630d4985ad981b727a5d441e5a41872ac0e"}
Nov 02 13:48:14.161124 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.161028    5453 generic.go:356] "Generic (PLEG): container finished" podID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerID="a4c0b6489152eaab530e2fef7655f8b822e106d249764f1a0f502a23a8f40a01" exitCode=0
Nov 02 13:48:14.161535 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.161116    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh" event={"ID":"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b","Type":"ContainerDied","Data":"a4c0b6489152eaab530e2fef7655f8b822e106d249764f1a0f502a23a8f40a01"}
Nov 02 13:48:14.165094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.164060    5453 generic.go:356] "Generic (PLEG): container finished" podID="667852f5-500f-406e-a648-2590caaeef64" containerID="133c4a99ce579fa9b0b030d18b4cc9fc9ea59fb53da9880dc8e792cb0db4f744" exitCode=0
Nov 02 13:48:14.165094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.164173    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd" event={"ID":"667852f5-500f-406e-a648-2590caaeef64","Type":"ContainerDied","Data":"133c4a99ce579fa9b0b030d18b4cc9fc9ea59fb53da9880dc8e792cb0db4f744"}
Nov 02 13:48:14.167770 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.166855    5453 generic.go:356] "Generic (PLEG): container finished" podID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerID="1b32e142c0ea57ed4d536873d6465c68b2a37331e5e96ef30cf15eabf61d41d4" exitCode=0
Nov 02 13:48:14.167770 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.166937    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt" event={"ID":"a4bfa603-5e84-4673-b367-8ab31c9ed353","Type":"ContainerDied","Data":"1b32e142c0ea57ed4d536873d6465c68b2a37331e5e96ef30cf15eabf61d41d4"}
Nov 02 13:48:14.169787 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.169662    5453 generic.go:356] "Generic (PLEG): container finished" podID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerID="5c556168c5e9fb6d7bfd688931f7ebfb566fef440f0951d33b3e3913947269ba" exitCode=0
Nov 02 13:48:14.169787 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.169738    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm" event={"ID":"05e84fdb-797b-4ceb-8f51-8acabb6b90c3","Type":"ContainerDied","Data":"5c556168c5e9fb6d7bfd688931f7ebfb566fef440f0951d33b3e3913947269ba"}
Nov 02 13:48:14.171950 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.171924    5453 generic.go:356] "Generic (PLEG): container finished" podID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerID="8ecc5da85fe2c78926f41546743068919fc46072811c35a05a7e4c855b65de77" exitCode=0
Nov 02 13:48:14.172047 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:14.171972    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn" event={"ID":"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa","Type":"ContainerDied","Data":"8ecc5da85fe2c78926f41546743068919fc46072811c35a05a7e4c855b65de77"}
Nov 02 13:48:15.179715 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:15.179665    5453 generic.go:356] "Generic (PLEG): container finished" podID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerID="8688a067043f514e607b78080f38c5c7157ef2d4d8e5a01966b2fed6d85cda5d" exitCode=0
Nov 02 13:48:15.180230 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:15.179785    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc" event={"ID":"8a4aebd0-2723-4cff-8df9-8f56125f85e4","Type":"ContainerDied","Data":"8688a067043f514e607b78080f38c5c7157ef2d4d8e5a01966b2fed6d85cda5d"}
Nov 02 13:48:15.195679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:15.195639    5453 generic.go:356] "Generic (PLEG): container finished" podID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerID="5420756b6ee6e058d4e58d30d8cfd95aa447f621524acd1cc163f4516e417e67" exitCode=0
Nov 02 13:48:15.195794 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:15.195750    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s" event={"ID":"1f50bcbd-6f49-4cd0-9680-eca71a777fda","Type":"ContainerDied","Data":"5420756b6ee6e058d4e58d30d8cfd95aa447f621524acd1cc163f4516e417e67"}
Nov 02 13:48:16.213574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:16.213481    5453 generic.go:356] "Generic (PLEG): container finished" podID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerID="857ec1d34a5e7040a13dd975021eace30426dfde87469e3b9de43390f5b3f621" exitCode=0
Nov 02 13:48:16.214029 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:16.213605    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq" event={"ID":"727d3758-3eb1-4f06-8666-f82c4fe40608","Type":"ContainerDied","Data":"857ec1d34a5e7040a13dd975021eace30426dfde87469e3b9de43390f5b3f621"}
Nov 02 13:48:33.404790 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:33.404093    5453 generic.go:356] "Generic (PLEG): container finished" podID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerID="520e917559f2c099497206a92f394019583444ca563b6660dc05e8475703d14c" exitCode=0
Nov 02 13:48:33.404790 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:33.404257    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm" event={"ID":"05e84fdb-797b-4ceb-8f51-8acabb6b90c3","Type":"ContainerDied","Data":"520e917559f2c099497206a92f394019583444ca563b6660dc05e8475703d14c"}
Nov 02 13:48:34.412896 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.412800    5453 generic.go:356] "Generic (PLEG): container finished" podID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerID="04c0069618c805fd2dbaf0a2a540c668e449dfd169c36d39b2412750299dd721" exitCode=0
Nov 02 13:48:34.413416 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.412894    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq" event={"ID":"727d3758-3eb1-4f06-8666-f82c4fe40608","Type":"ContainerDied","Data":"04c0069618c805fd2dbaf0a2a540c668e449dfd169c36d39b2412750299dd721"}
Nov 02 13:48:34.415968 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.415925    5453 generic.go:356] "Generic (PLEG): container finished" podID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerID="ca24104ef0352b4bbb356d7d53e3c9cd5e324a980940ca32cbee7320f293ce89" exitCode=0
Nov 02 13:48:34.416147 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.416020    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s" event={"ID":"1f50bcbd-6f49-4cd0-9680-eca71a777fda","Type":"ContainerDied","Data":"ca24104ef0352b4bbb356d7d53e3c9cd5e324a980940ca32cbee7320f293ce89"}
Nov 02 13:48:34.419515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.419488    5453 generic.go:356] "Generic (PLEG): container finished" podID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerID="baa0ebeb915bc8784986e2afb879d0c31c6aacf724b0d907c4e02b9d04e134bd" exitCode=0
Nov 02 13:48:34.419664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.419571    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt" event={"ID":"a4bfa603-5e84-4673-b367-8ab31c9ed353","Type":"ContainerDied","Data":"baa0ebeb915bc8784986e2afb879d0c31c6aacf724b0d907c4e02b9d04e134bd"}
Nov 02 13:48:34.422448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.422417    5453 generic.go:356] "Generic (PLEG): container finished" podID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerID="ea13bdcfbd6fef24f08b9bea0632ded0606668163fb1f732625da49750a1cf52" exitCode=0
Nov 02 13:48:34.422609 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.422508    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn" event={"ID":"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa","Type":"ContainerDied","Data":"ea13bdcfbd6fef24f08b9bea0632ded0606668163fb1f732625da49750a1cf52"}
Nov 02 13:48:34.625572 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.625530    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:34.682402 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.682369    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-kube-api-access-q7nf9\" (UniqueName: \"kubernetes.io/projected/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-kube-api-access-q7nf9\") pod \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") "
Nov 02 13:48:34.682571 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.682448    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-util\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-util\") pod \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") "
Nov 02 13:48:34.682571 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.682490    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-bundle\") pod \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\" (UID: \"05e84fdb-797b-4ceb-8f51-8acabb6b90c3\") "
Nov 02 13:48:34.683358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.683279    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-bundle" pod "05e84fdb-797b-4ceb-8f51-8acabb6b90c3" (UID: "05e84fdb-797b-4ceb-8f51-8acabb6b90c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:34.685386 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.685352    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-kube-api-access-q7nf9" pod "05e84fdb-797b-4ceb-8f51-8acabb6b90c3" (UID: "05e84fdb-797b-4ceb-8f51-8acabb6b90c3"). InnerVolumeSpecName "kube-api-access-q7nf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:34.688151 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.688122    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-util" pod "05e84fdb-797b-4ceb-8f51-8acabb6b90c3" (UID: "05e84fdb-797b-4ceb-8f51-8acabb6b90c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:34.783434 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.783398    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7nf9\" (UniqueName: \"kubernetes.io/projected/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-kube-api-access-q7nf9\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:34.783434 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.783436    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:34.783694 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:34.783451    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05e84fdb-797b-4ceb-8f51-8acabb6b90c3-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.430680 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.430589    5453 generic.go:356] "Generic (PLEG): container finished" podID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerID="5b761ecb4a3a64573ab1afe928e8c45bf556e05f6cb000ec5b0ea8ba44791789" exitCode=0
Nov 02 13:48:35.431185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.430684    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh" event={"ID":"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b","Type":"ContainerDied","Data":"5b761ecb4a3a64573ab1afe928e8c45bf556e05f6cb000ec5b0ea8ba44791789"}
Nov 02 13:48:35.433364 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.433331    5453 generic.go:356] "Generic (PLEG): container finished" podID="e069c24d-c19d-446c-b272-f0724b1800fc" containerID="84c17cf914dd86e9366e11ea199a68b1152b10c4bd436eb0c3338d5a3c425d31" exitCode=0
Nov 02 13:48:35.433504 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.433443    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj" event={"ID":"e069c24d-c19d-446c-b272-f0724b1800fc","Type":"ContainerDied","Data":"84c17cf914dd86e9366e11ea199a68b1152b10c4bd436eb0c3338d5a3c425d31"}
Nov 02 13:48:35.436667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.436644    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm"
Nov 02 13:48:35.436811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.436706    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arp5bm" event={"ID":"05e84fdb-797b-4ceb-8f51-8acabb6b90c3","Type":"ContainerDied","Data":"4ec710569dbcfbc5ede6f52b0e8447abc02f7eb61c87493e580de436c23be102"}
Nov 02 13:48:35.436811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.436747    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ec710569dbcfbc5ede6f52b0e8447abc02f7eb61c87493e580de436c23be102"
Nov 02 13:48:35.637537 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.637505    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:48:35.663680 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.663643    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:35.700181 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.699779    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/727d3758-3eb1-4f06-8666-f82c4fe40608-kube-api-access-hrq4f\" (UniqueName: \"kubernetes.io/projected/727d3758-3eb1-4f06-8666-f82c4fe40608-kube-api-access-hrq4f\") pod \"727d3758-3eb1-4f06-8666-f82c4fe40608\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") "
Nov 02 13:48:35.700181 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.699828    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-bundle\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-bundle\") pod \"727d3758-3eb1-4f06-8666-f82c4fe40608\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") "
Nov 02 13:48:35.700181 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.699884    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-util\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-util\") pod \"727d3758-3eb1-4f06-8666-f82c4fe40608\" (UID: \"727d3758-3eb1-4f06-8666-f82c4fe40608\") "
Nov 02 13:48:35.705022 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.703601    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-bundle" pod "727d3758-3eb1-4f06-8666-f82c4fe40608" (UID: "727d3758-3eb1-4f06-8666-f82c4fe40608"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.707002 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.706963    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727d3758-3eb1-4f06-8666-f82c4fe40608-kube-api-access-hrq4f" pod "727d3758-3eb1-4f06-8666-f82c4fe40608" (UID: "727d3758-3eb1-4f06-8666-f82c4fe40608"). InnerVolumeSpecName "kube-api-access-hrq4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:35.709461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.709428    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-util" pod "727d3758-3eb1-4f06-8666-f82c4fe40608" (UID: "727d3758-3eb1-4f06-8666-f82c4fe40608"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.712397 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.712370    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:35.734659 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.734614    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:48:35.800669 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.800644    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-bundle\") pod \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") "
Nov 02 13:48:35.800767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.800705    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-bundle\") pod \"a4bfa603-5e84-4673-b367-8ab31c9ed353\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") "
Nov 02 13:48:35.800767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.800748    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-kube-api-access-zvlpl\") pod \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") "
Nov 02 13:48:35.800886 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.800773    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-bundle\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-bundle\") pod \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") "
Nov 02 13:48:35.800886 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.800811    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-util\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-util\") pod \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") "
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801190    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4bfa603-5e84-4673-b367-8ab31c9ed353-kube-api-access-9ckdn\" (UniqueName: \"kubernetes.io/projected/a4bfa603-5e84-4673-b367-8ab31c9ed353-kube-api-access-9ckdn\") pod \"a4bfa603-5e84-4673-b367-8ab31c9ed353\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") "
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801229    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-bundle" pod "1f50bcbd-6f49-4cd0-9680-eca71a777fda" (UID: "1f50bcbd-6f49-4cd0-9680-eca71a777fda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801266    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-util\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-util\") pod \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\" (UID: \"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa\") "
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801319    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f50bcbd-6f49-4cd0-9680-eca71a777fda-kube-api-access-lcgvx\" (UniqueName: \"kubernetes.io/projected/1f50bcbd-6f49-4cd0-9680-eca71a777fda-kube-api-access-lcgvx\") pod \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\" (UID: \"1f50bcbd-6f49-4cd0-9680-eca71a777fda\") "
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801350    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-util\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-util\") pod \"a4bfa603-5e84-4673-b367-8ab31c9ed353\" (UID: \"a4bfa603-5e84-4673-b367-8ab31c9ed353\") "
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801460    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-bundle" pod "a4bfa603-5e84-4673-b367-8ab31c9ed353" (UID: "a4bfa603-5e84-4673-b367-8ab31c9ed353"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801548    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-bundle" pod "34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" (UID: "34a7bde7-305c-4c2c-bcc5-c48afae4f5aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801641    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801660    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801698    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801715    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrq4f\" (UniqueName: \"kubernetes.io/projected/727d3758-3eb1-4f06-8666-f82c4fe40608-kube-api-access-hrq4f\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801733    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.803118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.801766    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/727d3758-3eb1-4f06-8666-f82c4fe40608-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.803948 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.803465    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-kube-api-access-zvlpl" pod "34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" (UID: "34a7bde7-305c-4c2c-bcc5-c48afae4f5aa"). InnerVolumeSpecName "kube-api-access-zvlpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:35.804816 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.804790    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4bfa603-5e84-4673-b367-8ab31c9ed353-kube-api-access-9ckdn" pod "a4bfa603-5e84-4673-b367-8ab31c9ed353" (UID: "a4bfa603-5e84-4673-b367-8ab31c9ed353"). InnerVolumeSpecName "kube-api-access-9ckdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:35.804816 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.804806    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f50bcbd-6f49-4cd0-9680-eca71a777fda-kube-api-access-lcgvx" pod "1f50bcbd-6f49-4cd0-9680-eca71a777fda" (UID: "1f50bcbd-6f49-4cd0-9680-eca71a777fda"). InnerVolumeSpecName "kube-api-access-lcgvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:35.809084 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.809037    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-util" pod "1f50bcbd-6f49-4cd0-9680-eca71a777fda" (UID: "1f50bcbd-6f49-4cd0-9680-eca71a777fda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.809208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.809036    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-util" pod "34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" (UID: "34a7bde7-305c-4c2c-bcc5-c48afae4f5aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.810770 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.810744    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-util" pod "a4bfa603-5e84-4673-b367-8ab31c9ed353" (UID: "a4bfa603-5e84-4673-b367-8ab31c9ed353"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:35.903209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.903164    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvlpl\" (UniqueName: \"kubernetes.io/projected/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-kube-api-access-zvlpl\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.903209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.903210    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f50bcbd-6f49-4cd0-9680-eca71a777fda-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.903391 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.903224    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ckdn\" (UniqueName: \"kubernetes.io/projected/a4bfa603-5e84-4673-b367-8ab31c9ed353-kube-api-access-9ckdn\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.903391 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.903236    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34a7bde7-305c-4c2c-bcc5-c48afae4f5aa-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.903391 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.903248    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcgvx\" (UniqueName: \"kubernetes.io/projected/1f50bcbd-6f49-4cd0-9680-eca71a777fda-kube-api-access-lcgvx\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:35.903391 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:35.903260    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4bfa603-5e84-4673-b367-8ab31c9ed353-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:36.082746 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:48:36.082707    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:48:36.444090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.444039    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq" event={"ID":"727d3758-3eb1-4f06-8666-f82c4fe40608","Type":"ContainerDied","Data":"c622594ff50850943b4c697832be89179be8ce5f807832ab9975fb077a773447"}
Nov 02 13:48:36.444564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.444143    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c622594ff50850943b4c697832be89179be8ce5f807832ab9975fb077a773447"
Nov 02 13:48:36.444564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.444049    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644bltpq"
Nov 02 13:48:36.446470 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.446446    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s"
Nov 02 13:48:36.446470 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.446452    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hz25s" event={"ID":"1f50bcbd-6f49-4cd0-9680-eca71a777fda","Type":"ContainerDied","Data":"c4de91f9a8d6b2f4ee2002c908459884b4722f6518f96057956a0b6c49b5b345"}
Nov 02 13:48:36.446682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.446516    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4de91f9a8d6b2f4ee2002c908459884b4722f6518f96057956a0b6c49b5b345"
Nov 02 13:48:36.449356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.449331    5453 generic.go:356] "Generic (PLEG): container finished" podID="667852f5-500f-406e-a648-2590caaeef64" containerID="98d7bc801ba96d20a537cba3f575d23b497cdd9203a989333adc0100c1d5236b" exitCode=0
Nov 02 13:48:36.449532 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.449403    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd" event={"ID":"667852f5-500f-406e-a648-2590caaeef64","Type":"ContainerDied","Data":"98d7bc801ba96d20a537cba3f575d23b497cdd9203a989333adc0100c1d5236b"}
Nov 02 13:48:36.451493 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.451458    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt" event={"ID":"a4bfa603-5e84-4673-b367-8ab31c9ed353","Type":"ContainerDied","Data":"d916df9c0f36299ee766d15314d225b3ea19813873ae58dfe9cea9ac51e9b898"}
Nov 02 13:48:36.451642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.451499    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71tmprt"
Nov 02 13:48:36.451642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.451514    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d916df9c0f36299ee766d15314d225b3ea19813873ae58dfe9cea9ac51e9b898"
Nov 02 13:48:36.454210 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.454032    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn"
Nov 02 13:48:36.454210 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.454036    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cmzjsn" event={"ID":"34a7bde7-305c-4c2c-bcc5-c48afae4f5aa","Type":"ContainerDied","Data":"af9540921ddd7320e7900351fc1c3fa245546b0aeb02a65909396e3e847627af"}
Nov 02 13:48:36.454210 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.454100    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af9540921ddd7320e7900351fc1c3fa245546b0aeb02a65909396e3e847627af"
Nov 02 13:48:36.458601 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.458525    5453 generic.go:356] "Generic (PLEG): container finished" podID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerID="b6ca3c441681ff47c892323230c0fce3bd56c6867a5ad8366f93c39ecf6fb11e" exitCode=0
Nov 02 13:48:36.458952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.458926    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc" event={"ID":"8a4aebd0-2723-4cff-8df9-8f56125f85e4","Type":"ContainerDied","Data":"b6ca3c441681ff47c892323230c0fce3bd56c6867a5ad8366f93c39ecf6fb11e"}
Nov 02 13:48:36.589889 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.589863    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:36.613033 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.613003    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:48:36.709529 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.709425    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e069c24d-c19d-446c-b272-f0724b1800fc-kube-api-access-csn6l\" (UniqueName: \"kubernetes.io/projected/e069c24d-c19d-446c-b272-f0724b1800fc-kube-api-access-csn6l\") pod \"e069c24d-c19d-446c-b272-f0724b1800fc\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") "
Nov 02 13:48:36.709529 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.709476    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-bundle\") pod \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") "
Nov 02 13:48:36.709529 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.709510    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-kube-api-access-462fl\" (UniqueName: \"kubernetes.io/projected/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-kube-api-access-462fl\") pod \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") "
Nov 02 13:48:36.709529 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.709529    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-util\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-util\") pod \"e069c24d-c19d-446c-b272-f0724b1800fc\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") "
Nov 02 13:48:36.709875 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.709571    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-util\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-util\") pod \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\" (UID: \"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b\") "
Nov 02 13:48:36.709875 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.709633    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-bundle\") pod \"e069c24d-c19d-446c-b272-f0724b1800fc\" (UID: \"e069c24d-c19d-446c-b272-f0724b1800fc\") "
Nov 02 13:48:36.710185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.710158    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-bundle" pod "442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" (UID: "442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:36.710393 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.710370    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-bundle" pod "e069c24d-c19d-446c-b272-f0724b1800fc" (UID: "e069c24d-c19d-446c-b272-f0724b1800fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:36.712401 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.712376    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-kube-api-access-462fl" pod "442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" (UID: "442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b"). InnerVolumeSpecName "kube-api-access-462fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:36.712516 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.712410    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e069c24d-c19d-446c-b272-f0724b1800fc-kube-api-access-csn6l" pod "e069c24d-c19d-446c-b272-f0724b1800fc" (UID: "e069c24d-c19d-446c-b272-f0724b1800fc"). InnerVolumeSpecName "kube-api-access-csn6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:36.715640 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.715608    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-util" pod "442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" (UID: "442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:36.715744 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.715611    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-util" pod "e069c24d-c19d-446c-b272-f0724b1800fc" (UID: "e069c24d-c19d-446c-b272-f0724b1800fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:36.810643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.810603    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:36.810643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.810635    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:36.810643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.810645    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csn6l\" (UniqueName: \"kubernetes.io/projected/e069c24d-c19d-446c-b272-f0724b1800fc-kube-api-access-csn6l\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:36.810643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.810655    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:36.810924 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.810664    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-462fl\" (UniqueName: \"kubernetes.io/projected/442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b-kube-api-access-462fl\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:36.810924 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:36.810672    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e069c24d-c19d-446c-b272-f0724b1800fc-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:37.464209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.464111    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh" event={"ID":"442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b","Type":"ContainerDied","Data":"4748d759e07ed06a6ad96f7a86051f40c36a106d760165cae54b47f04401fd11"}
Nov 02 13:48:37.464209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.464151    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8cmnh"
Nov 02 13:48:37.464209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.464174    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4748d759e07ed06a6ad96f7a86051f40c36a106d760165cae54b47f04401fd11"
Nov 02 13:48:37.466292 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.466267    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj"
Nov 02 13:48:37.466449 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.466357    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71cstmj" event={"ID":"e069c24d-c19d-446c-b272-f0724b1800fc","Type":"ContainerDied","Data":"cfd0609ec63f91e7f2b708b6fceb866049bfb630241a6f70d423c8dc779847e7"}
Nov 02 13:48:37.466449 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.466402    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfd0609ec63f91e7f2b708b6fceb866049bfb630241a6f70d423c8dc779847e7"
Nov 02 13:48:37.614894 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.614865    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:37.617294 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.617272    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:37.716510 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.716415    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-bundle\") pod \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") "
Nov 02 13:48:37.716510 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.716468    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a4aebd0-2723-4cff-8df9-8f56125f85e4-kube-api-access-5vj5x\" (UniqueName: \"kubernetes.io/projected/8a4aebd0-2723-4cff-8df9-8f56125f85e4-kube-api-access-5vj5x\") pod \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") "
Nov 02 13:48:37.716510 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.716503    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-bundle\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-bundle\") pod \"667852f5-500f-406e-a648-2590caaeef64\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") "
Nov 02 13:48:37.716748 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.716526    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-util\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-util\") pod \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\" (UID: \"8a4aebd0-2723-4cff-8df9-8f56125f85e4\") "
Nov 02 13:48:37.716748 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.716598    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/667852f5-500f-406e-a648-2590caaeef64-kube-api-access-2ww46\" (UniqueName: \"kubernetes.io/projected/667852f5-500f-406e-a648-2590caaeef64-kube-api-access-2ww46\") pod \"667852f5-500f-406e-a648-2590caaeef64\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") "
Nov 02 13:48:37.716748 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.716629    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-util\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-util\") pod \"667852f5-500f-406e-a648-2590caaeef64\" (UID: \"667852f5-500f-406e-a648-2590caaeef64\") "
Nov 02 13:48:37.717270 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.717236    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-bundle" pod "667852f5-500f-406e-a648-2590caaeef64" (UID: "667852f5-500f-406e-a648-2590caaeef64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:37.717405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.717357    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-bundle" pod "8a4aebd0-2723-4cff-8df9-8f56125f85e4" (UID: "8a4aebd0-2723-4cff-8df9-8f56125f85e4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:37.718879 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.718852    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a4aebd0-2723-4cff-8df9-8f56125f85e4-kube-api-access-5vj5x" pod "8a4aebd0-2723-4cff-8df9-8f56125f85e4" (UID: "8a4aebd0-2723-4cff-8df9-8f56125f85e4"). InnerVolumeSpecName "kube-api-access-5vj5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:37.719225 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.719187    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667852f5-500f-406e-a648-2590caaeef64-kube-api-access-2ww46" pod "667852f5-500f-406e-a648-2590caaeef64" (UID: "667852f5-500f-406e-a648-2590caaeef64"). InnerVolumeSpecName "kube-api-access-2ww46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:48:37.723798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.723765    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-util" pod "667852f5-500f-406e-a648-2590caaeef64" (UID: "667852f5-500f-406e-a648-2590caaeef64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:37.724970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.724939    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-util" pod "8a4aebd0-2723-4cff-8df9-8f56125f85e4" (UID: "8a4aebd0-2723-4cff-8df9-8f56125f85e4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:48:37.800165 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.800126    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:37.817340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.817311    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vj5x\" (UniqueName: \"kubernetes.io/projected/8a4aebd0-2723-4cff-8df9-8f56125f85e4-kube-api-access-5vj5x\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:37.817340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.817336    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:37.817340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.817346    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:37.817563 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.817355    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ww46\" (UniqueName: \"kubernetes.io/projected/667852f5-500f-406e-a648-2590caaeef64-kube-api-access-2ww46\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:37.817563 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.817365    5453 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/667852f5-500f-406e-a648-2590caaeef64-util\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:37.817563 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:37.817376    5453 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a4aebd0-2723-4cff-8df9-8f56125f85e4-bundle\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:48:38.037560 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.037524    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:38.472496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.472402    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd"
Nov 02 13:48:38.472496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.472432    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7sp2kd" event={"ID":"667852f5-500f-406e-a648-2590caaeef64","Type":"ContainerDied","Data":"734abe8687573dd07d4bcb616e36cd5649f88d9274590739a78331690bd3ea40"}
Nov 02 13:48:38.472496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.472482    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="734abe8687573dd07d4bcb616e36cd5649f88d9274590739a78331690bd3ea40"
Nov 02 13:48:38.474464 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.474435    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc" event={"ID":"8a4aebd0-2723-4cff-8df9-8f56125f85e4","Type":"ContainerDied","Data":"4cbee6cd41a336b933d403d5c43470be24652d86f2b5f0b927df513fa5ab2c03"}
Nov 02 13:48:38.474464 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.474463    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cm8wfc"
Nov 02 13:48:38.474619 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.474483    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cbee6cd41a336b933d403d5c43470be24652d86f2b5f0b927df513fa5ab2c03"
Nov 02 13:48:38.962253 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962214    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"]
Nov 02 13:48:38.962520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962507    5453 cpu_manager.go:414] "containerMap: removing container" podUID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerName="util"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962521    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerName="util"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962532    5453 cpu_manager.go:414] "containerMap: removing container" podUID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerName="pull"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962537    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerName="pull"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962547    5453 cpu_manager.go:414] "containerMap: removing container" podUID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerName="pull"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962552    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerName="pull"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962559    5453 cpu_manager.go:414] "containerMap: removing container" podUID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerName="util"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962563    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerName="util"
Nov 02 13:48:38.962569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962569    5453 cpu_manager.go:414] "containerMap: removing container" podUID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962575    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962581    5453 cpu_manager.go:414] "containerMap: removing container" podUID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962585    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962595    5453 cpu_manager.go:414] "containerMap: removing container" podUID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962601    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962607    5453 cpu_manager.go:414] "containerMap: removing container" podUID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962611    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962616    5453 cpu_manager.go:414] "containerMap: removing container" podUID="e069c24d-c19d-446c-b272-f0724b1800fc" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962620    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e069c24d-c19d-446c-b272-f0724b1800fc" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962627    5453 cpu_manager.go:414] "containerMap: removing container" podUID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962631    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962638    5453 cpu_manager.go:414] "containerMap: removing container" podUID="e069c24d-c19d-446c-b272-f0724b1800fc" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962643    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e069c24d-c19d-446c-b272-f0724b1800fc" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962648    5453 cpu_manager.go:414] "containerMap: removing container" podUID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962653    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962660    5453 cpu_manager.go:414] "containerMap: removing container" podUID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962664    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962669    5453 cpu_manager.go:414] "containerMap: removing container" podUID="667852f5-500f-406e-a648-2590caaeef64" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962673    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="667852f5-500f-406e-a648-2590caaeef64" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962678    5453 cpu_manager.go:414] "containerMap: removing container" podUID="667852f5-500f-406e-a648-2590caaeef64" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962682    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="667852f5-500f-406e-a648-2590caaeef64" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962687    5453 cpu_manager.go:414] "containerMap: removing container" podUID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962691    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962697    5453 cpu_manager.go:414] "containerMap: removing container" podUID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962701    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962706    5453 cpu_manager.go:414] "containerMap: removing container" podUID="e069c24d-c19d-446c-b272-f0724b1800fc" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962710    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e069c24d-c19d-446c-b272-f0724b1800fc" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962716    5453 cpu_manager.go:414] "containerMap: removing container" podUID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962720    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerName="util"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962725    5453 cpu_manager.go:414] "containerMap: removing container" podUID="667852f5-500f-406e-a648-2590caaeef64" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962729    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="667852f5-500f-406e-a648-2590caaeef64" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962737    5453 cpu_manager.go:414] "containerMap: removing container" podUID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962741    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962746    5453 cpu_manager.go:414] "containerMap: removing container" podUID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962750    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962759    5453 cpu_manager.go:414] "containerMap: removing container" podUID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962763    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962769    5453 cpu_manager.go:414] "containerMap: removing container" podUID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962773    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962778    5453 cpu_manager.go:414] "containerMap: removing container" podUID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962782    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962791    5453 cpu_manager.go:414] "containerMap: removing container" podUID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962794    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerName="pull"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962800    5453 cpu_manager.go:414] "containerMap: removing container" podUID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerName="extract"
Nov 02 13:48:38.962784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962805    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962843    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="e069c24d-c19d-446c-b272-f0724b1800fc" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962850    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f50bcbd-6f49-4cd0-9680-eca71a777fda" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962854    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="727d3758-3eb1-4f06-8666-f82c4fe40608" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962860    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="34a7bde7-305c-4c2c-bcc5-c48afae4f5aa" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962866    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="667852f5-500f-406e-a648-2590caaeef64" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962872    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="442a0a8e-2497-4fb8-b75c-3c2fa2ca3f5b" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962878    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4bfa603-5e84-4673-b367-8ab31c9ed353" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962883    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="05e84fdb-797b-4ceb-8f51-8acabb6b90c3" containerName="extract"
Nov 02 13:48:38.964104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.962888    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a4aebd0-2723-4cff-8df9-8f56125f85e4" containerName="extract"
Nov 02 13:48:38.965206 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.965189    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:38.982179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.982150    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 02 13:48:38.982340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:38.982205    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 02 13:48:39.019908 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.019860    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"]
Nov 02 13:48:39.024471 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.024447    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-lf54j\""
Nov 02 13:48:39.028664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.028635    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbz5z\" (UniqueName: \"kubernetes.io/projected/6cd425bc-cb94-462a-b310-05e9e1fa0c22-kube-api-access-pbz5z\") pod \"jobset-operator-674cd59dc5-d7fv2\" (UID: \"6cd425bc-cb94-462a-b310-05e9e1fa0c22\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:39.028797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.028687    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd425bc-cb94-462a-b310-05e9e1fa0c22-tmp\") pod \"jobset-operator-674cd59dc5-d7fv2\" (UID: \"6cd425bc-cb94-462a-b310-05e9e1fa0c22\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:39.129499 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.129453    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd425bc-cb94-462a-b310-05e9e1fa0c22-tmp\") pod \"jobset-operator-674cd59dc5-d7fv2\" (UID: \"6cd425bc-cb94-462a-b310-05e9e1fa0c22\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:39.129716 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.129534    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbz5z\" (UniqueName: \"kubernetes.io/projected/6cd425bc-cb94-462a-b310-05e9e1fa0c22-kube-api-access-pbz5z\") pod \"jobset-operator-674cd59dc5-d7fv2\" (UID: \"6cd425bc-cb94-462a-b310-05e9e1fa0c22\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:39.129847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.129826    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd425bc-cb94-462a-b310-05e9e1fa0c22-tmp\") pod \"jobset-operator-674cd59dc5-d7fv2\" (UID: \"6cd425bc-cb94-462a-b310-05e9e1fa0c22\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:39.167252 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.167195    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbz5z\" (UniqueName: \"kubernetes.io/projected/6cd425bc-cb94-462a-b310-05e9e1fa0c22-kube-api-access-pbz5z\") pod \"jobset-operator-674cd59dc5-d7fv2\" (UID: \"6cd425bc-cb94-462a-b310-05e9e1fa0c22\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:39.288615 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.288576    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"
Nov 02 13:48:39.610818 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:39.610794    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2"]
Nov 02 13:48:39.613537 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:48:39.613507    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cd425bc_cb94_462a_b310_05e9e1fa0c22.slice/crio-3c73aabff85c336d99254f04ba19d68bc0845453d022f55f889e7f9755d9b029 WatchSource:0}: Error finding container 3c73aabff85c336d99254f04ba19d68bc0845453d022f55f889e7f9755d9b029: Status 404 returned error can't find the container with id 3c73aabff85c336d99254f04ba19d68bc0845453d022f55f889e7f9755d9b029
Nov 02 13:48:40.484383 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:40.484349    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2" event={"ID":"6cd425bc-cb94-462a-b310-05e9e1fa0c22","Type":"ContainerStarted","Data":"3c73aabff85c336d99254f04ba19d68bc0845453d022f55f889e7f9755d9b029"}
Nov 02 13:48:42.495875 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:42.495835    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2" event={"ID":"6cd425bc-cb94-462a-b310-05e9e1fa0c22","Type":"ContainerStarted","Data":"c398c2980fccaf110cf52f7374bf0d780c18ab97afe943738ee929188053b13b"}
Nov 02 13:48:44.062263 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:44.062209    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:44.227649 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:44.227608    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:45.176784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.176744    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:45.288600 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.288542    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-d7fv2" podStartSLOduration=5.223639129 podStartE2EDuration="7.288527229s" totalImagesPullingTime="2.0648881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:48:42.527096267 +0000 UTC m=+301.608241376" watchObservedRunningTime="2026-11-02 13:48:45.288527229 +0000 UTC m=+304.369672347"
Nov 02 13:48:45.288811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.288692    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"]
Nov 02 13:48:45.291002 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.290985    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.302517 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.302490    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 02 13:48:45.302517 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.302511    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 02 13:48:45.302710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.302490    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 02 13:48:45.302710 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.302567    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 02 13:48:45.356009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.355959    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"]
Nov 02 13:48:45.377613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.377580    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxsbd\" (UniqueName: \"kubernetes.io/projected/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-kube-api-access-pxsbd\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.377769 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.377622    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.377769 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.377650    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-tmp\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.377849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.377801    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.377849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.377834    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-metrics-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.377912 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.377862    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-manifests\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.402290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.402250    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-qdqbf\""
Nov 02 13:48:45.402639 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.402616    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 02 13:48:45.479394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.479293    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-manifests\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.479394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.479339    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxsbd\" (UniqueName: \"kubernetes.io/projected/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-kube-api-access-pxsbd\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.479645 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.479483    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.479645 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.479537    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-tmp\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.479645 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.479624    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.479781 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.479661    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-metrics-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.479781 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.479741    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-manifests\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.482049 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.482020    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-tmp\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.482306 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.482286    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.482376 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.482312    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.482415 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.482380    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-metrics-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.520875 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.520840    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxsbd\" (UniqueName: \"kubernetes.io/projected/e1b3610a-bd1b-47c9-a004-0bf415c82cf5-kube-api-access-pxsbd\") pod \"opendatahub-operator-controller-manager-c559bd947-mdzp4\" (UID: \"e1b3610a-bd1b-47c9-a004-0bf415c82cf5\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.589332 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.589298    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:45.604239 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.604205    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:45.759268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.759159    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:45.917046 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.917013    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"]
Nov 02 13:48:45.918706 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:48:45.918675    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b3610a_bd1b_47c9_a004_0bf415c82cf5.slice/crio-98228df4edd84f26f70c8df1035da2520e151a2d195aad286a347be5c56d1fab WatchSource:0}: Error finding container 98228df4edd84f26f70c8df1035da2520e151a2d195aad286a347be5c56d1fab: Status 404 returned error can't find the container with id 98228df4edd84f26f70c8df1035da2520e151a2d195aad286a347be5c56d1fab
Nov 02 13:48:45.919328 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:45.919301    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:46.165775 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:46.165747    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:46.514337 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:46.514239    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4" event={"ID":"e1b3610a-bd1b-47c9-a004-0bf415c82cf5","Type":"ContainerStarted","Data":"98228df4edd84f26f70c8df1035da2520e151a2d195aad286a347be5c56d1fab"}
Nov 02 13:48:49.111872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:49.111834    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:49.532506 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:49.532472    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4" event={"ID":"e1b3610a-bd1b-47c9-a004-0bf415c82cf5","Type":"ContainerStarted","Data":"c46fc0c6740fa1f1627873a93d38358b688396ee865d7e9b574472f84e1fde30"}
Nov 02 13:48:49.854975 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:49.854936    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:50.537946 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:50.537907    5453 generic.go:356] "Generic (PLEG): container finished" podID="e1b3610a-bd1b-47c9-a004-0bf415c82cf5" containerID="c46fc0c6740fa1f1627873a93d38358b688396ee865d7e9b574472f84e1fde30" exitCode=0
Nov 02 13:48:50.538436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:50.537994    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4" event={"ID":"e1b3610a-bd1b-47c9-a004-0bf415c82cf5","Type":"ContainerDied","Data":"c46fc0c6740fa1f1627873a93d38358b688396ee865d7e9b574472f84e1fde30"}
Nov 02 13:48:51.538765 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:51.538723    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:51.550416 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:51.550375    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4" event={"ID":"e1b3610a-bd1b-47c9-a004-0bf415c82cf5","Type":"ContainerStarted","Data":"af137548c201655bc9b4cea01fbbacdb8a0626faceb75b7758868e296c572ccd"}
Nov 02 13:48:51.550589 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:51.550575    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:48:51.621150 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:51.621099    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4" podStartSLOduration=2.256052147 podStartE2EDuration="6.621062326s" totalImagesPullingTime="3.920851666s" totalInitContainerRuntime="444.158513ms" isStatefulPod=false podCreationTimestamp="2026-11-02 13:48:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:48:51.618807892 +0000 UTC m=+310.699953010" watchObservedRunningTime="2026-11-02 13:48:51.621062326 +0000 UTC m=+310.702207523"
Nov 02 13:48:51.719759 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:51.719723    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:53.353293 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.353258    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"]
Nov 02 13:48:53.356736 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.356710    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"
Nov 02 13:48:53.372624 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.372592    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gmsxz\""
Nov 02 13:48:53.374159 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.374140    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 02 13:48:53.374294 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.374182    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 02 13:48:53.382099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.382046    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"]
Nov 02 13:48:53.444972 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.444932    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlgxl\" (UniqueName: \"kubernetes.io/projected/931244c4-a71e-46c2-8ef9-ccab978d71b6-kube-api-access-xlgxl\") pod \"limitador-operator-controller-manager-5778bb4449-d2kd2\" (UID: \"931244c4-a71e-46c2-8ef9-ccab978d71b6\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"
Nov 02 13:48:53.545502 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.545466    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlgxl\" (UniqueName: \"kubernetes.io/projected/931244c4-a71e-46c2-8ef9-ccab978d71b6-kube-api-access-xlgxl\") pod \"limitador-operator-controller-manager-5778bb4449-d2kd2\" (UID: \"931244c4-a71e-46c2-8ef9-ccab978d71b6\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"
Nov 02 13:48:53.570565 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.570529    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlgxl\" (UniqueName: \"kubernetes.io/projected/931244c4-a71e-46c2-8ef9-ccab978d71b6-kube-api-access-xlgxl\") pod \"limitador-operator-controller-manager-5778bb4449-d2kd2\" (UID: \"931244c4-a71e-46c2-8ef9-ccab978d71b6\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"
Nov 02 13:48:53.670007 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.669902    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"
Nov 02 13:48:53.968628 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:53.968515    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"]
Nov 02 13:48:53.970877 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:48:53.970844    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931244c4_a71e_46c2_8ef9_ccab978d71b6.slice/crio-c85eb83b70c9c5756ad3bd7c88b313e9a23c9db3de67847e5ede9bbb11e87618 WatchSource:0}: Error finding container c85eb83b70c9c5756ad3bd7c88b313e9a23c9db3de67847e5ede9bbb11e87618: Status 404 returned error can't find the container with id c85eb83b70c9c5756ad3bd7c88b313e9a23c9db3de67847e5ede9bbb11e87618
Nov 02 13:48:54.522695 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:54.522652    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:54.565027 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:54.564989    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2" event={"ID":"931244c4-a71e-46c2-8ef9-ccab978d71b6","Type":"ContainerStarted","Data":"c85eb83b70c9c5756ad3bd7c88b313e9a23c9db3de67847e5ede9bbb11e87618"}
Nov 02 13:48:54.830959 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:54.830920    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:55.562786 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:55.562732    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:56.358316 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:56.358256    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:48:57.581841 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:57.581805    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2" event={"ID":"931244c4-a71e-46c2-8ef9-ccab978d71b6","Type":"ContainerStarted","Data":"081876dc1dcfc95af7ced0bee01d158a61bc87d29340c87159ec5a9ddd84f6dc"}
Nov 02 13:48:57.582279 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:57.581872    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"
Nov 02 13:48:57.622450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:57.622394    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2" podStartSLOduration=1.651985084 podStartE2EDuration="4.62238008s" totalImagesPullingTime="2.970394996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:48:57.621526481 +0000 UTC m=+316.702671600" watchObservedRunningTime="2026-11-02 13:48:57.62238008 +0000 UTC m=+316.703525198"
Nov 02 13:48:59.419444 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.419407    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"]
Nov 02 13:48:59.422789 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.422768    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:48:59.430288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.430265    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Nov 02 13:48:59.430473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.430352    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Nov 02 13:48:59.431630 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.431611    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6krxk\""
Nov 02 13:48:59.448358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.448324    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"]
Nov 02 13:48:59.503448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.503409    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc6d866a-4257-4541-8ad7-cbd0b9b18ae2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-czn94\" (UID: \"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:48:59.503448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.503448    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfrdv\" (UniqueName: \"kubernetes.io/projected/dc6d866a-4257-4541-8ad7-cbd0b9b18ae2-kube-api-access-rfrdv\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-czn94\" (UID: \"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:48:59.606315 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.606267    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc6d866a-4257-4541-8ad7-cbd0b9b18ae2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-czn94\" (UID: \"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:48:59.607175 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.607138    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfrdv\" (UniqueName: \"kubernetes.io/projected/dc6d866a-4257-4541-8ad7-cbd0b9b18ae2-kube-api-access-rfrdv\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-czn94\" (UID: \"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:48:59.607566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.607053    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc6d866a-4257-4541-8ad7-cbd0b9b18ae2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-czn94\" (UID: \"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:48:59.627838 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.627800    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfrdv\" (UniqueName: \"kubernetes.io/projected/dc6d866a-4257-4541-8ad7-cbd0b9b18ae2-kube-api-access-rfrdv\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-czn94\" (UID: \"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:48:59.735183 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:48:59.735084    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"
Nov 02 13:49:00.027807 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:00.027782    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94"]
Nov 02 13:49:00.030596 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:49:00.030565    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc6d866a_4257_4541_8ad7_cbd0b9b18ae2.slice/crio-ce0cc708a545f3528c8bc75124028e9f755cca0960672fcd909aa8464297337c WatchSource:0}: Error finding container ce0cc708a545f3528c8bc75124028e9f755cca0960672fcd909aa8464297337c: Status 404 returned error can't find the container with id ce0cc708a545f3528c8bc75124028e9f755cca0960672fcd909aa8464297337c
Nov 02 13:49:00.514445 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:00.514401    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:00.598766 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:00.598732    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94" event={"ID":"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2","Type":"ContainerStarted","Data":"ce0cc708a545f3528c8bc75124028e9f755cca0960672fcd909aa8464297337c"}
Nov 02 13:49:02.129322 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:02.129231    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:02.483575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:02.483497    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:02.557473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:02.557443    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-mdzp4"
Nov 02 13:49:02.620915 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:02.620871    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94" event={"ID":"dc6d866a-4257-4541-8ad7-cbd0b9b18ae2","Type":"ContainerStarted","Data":"1ee9344c8f8f4f05e008d142f1195b9c2642917db48ccde4c6290e81ae8a75dd"}
Nov 02 13:49:02.678121 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:02.678033    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-czn94" podStartSLOduration=1.856610335 podStartE2EDuration="3.678017471s" totalImagesPullingTime="1.821407136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:02.677095603 +0000 UTC m=+321.758240723" watchObservedRunningTime="2026-11-02 13:49:02.678017471 +0000 UTC m=+321.759162590"
Nov 02 13:49:02.742938 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:02.742830    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:03.083339 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.083306    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:03.732626 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.732587    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"]
Nov 02 13:49:03.753997 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.753964    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:03.766964 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.766937    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"]
Nov 02 13:49:03.768667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.768648    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-72vml\""
Nov 02 13:49:03.840963 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.840930    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:03.843179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.843139    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5dx4\" (UniqueName: \"kubernetes.io/projected/b58158f9-1894-4e70-bf93-450729b83833-kube-api-access-q5dx4\") pod \"kuadrant-operator-controller-manager-678d87766f-2wm5b\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:03.843328 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.843213    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58158f9-1894-4e70-bf93-450729b83833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-2wm5b\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:03.944058 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.944018    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58158f9-1894-4e70-bf93-450729b83833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-2wm5b\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:03.944253 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.944162    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5dx4\" (UniqueName: \"kubernetes.io/projected/b58158f9-1894-4e70-bf93-450729b83833-kube-api-access-q5dx4\") pod \"kuadrant-operator-controller-manager-678d87766f-2wm5b\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:03.944420 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.944400    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58158f9-1894-4e70-bf93-450729b83833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-2wm5b\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:03.969910 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:03.969876    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5dx4\" (UniqueName: \"kubernetes.io/projected/b58158f9-1894-4e70-bf93-450729b83833-kube-api-access-q5dx4\") pod \"kuadrant-operator-controller-manager-678d87766f-2wm5b\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:04.050459 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:04.050421    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:04.086590 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:04.086551    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:04.393416 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:04.393389    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"]
Nov 02 13:49:04.396667 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:49:04.396633    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58158f9_1894_4e70_bf93_450729b83833.slice/crio-f7cc17cd347e23dcfa7858d83d19771fb080180fc2ef2f9b7ddc31314df9089e WatchSource:0}: Error finding container f7cc17cd347e23dcfa7858d83d19771fb080180fc2ef2f9b7ddc31314df9089e: Status 404 returned error can't find the container with id f7cc17cd347e23dcfa7858d83d19771fb080180fc2ef2f9b7ddc31314df9089e
Nov 02 13:49:04.631873 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:04.631831    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b" event={"ID":"b58158f9-1894-4e70-bf93-450729b83833","Type":"ContainerStarted","Data":"f7cc17cd347e23dcfa7858d83d19771fb080180fc2ef2f9b7ddc31314df9089e"}
Nov 02 13:49:05.754130 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:05.754061    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:06.090192 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:49:06.090112    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:49:06.372869 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:06.372762    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:06.683811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:06.683724    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:08.089438 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:08.089408    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:08.276845 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:08.276799    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:08.588755 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:08.588707    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-d2kd2"
Nov 02 13:49:08.665105 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:08.663955    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b" event={"ID":"b58158f9-1894-4e70-bf93-450729b83833","Type":"ContainerStarted","Data":"afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552"}
Nov 02 13:49:08.665105 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:08.665016    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:08.713940 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:08.713874    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b" podStartSLOduration=1.6179047199999999 podStartE2EDuration="5.71384365s" totalImagesPullingTime="4.09593893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:08.711471817 +0000 UTC m=+327.792616957" watchObservedRunningTime="2026-11-02 13:49:08.71384365 +0000 UTC m=+327.794988775"
Nov 02 13:49:10.058607 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.058567    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"]
Nov 02 13:49:10.062170 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.062143    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.084597 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.083975    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"]
Nov 02 13:49:10.124328 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.124287    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Nov 02 13:49:10.124531 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.124405    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Nov 02 13:49:10.125402 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.125384    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6hrt4\""
Nov 02 13:49:10.139637 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.139586    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:10.200736 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.200696    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jqw6\" (UniqueName: \"kubernetes.io/projected/a47e1366-a355-4642-be3c-a138e9d0177f-kube-api-access-6jqw6\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.200941 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.200862    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47e1366-a355-4642-be3c-a138e9d0177f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.200941 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.200905    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a47e1366-a355-4642-be3c-a138e9d0177f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.302326 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.302277    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a47e1366-a355-4642-be3c-a138e9d0177f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.302522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.302372    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jqw6\" (UniqueName: \"kubernetes.io/projected/a47e1366-a355-4642-be3c-a138e9d0177f-kube-api-access-6jqw6\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.302522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.302459    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47e1366-a355-4642-be3c-a138e9d0177f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.302986 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.302965    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a47e1366-a355-4642-be3c-a138e9d0177f-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.305135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.305112    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a47e1366-a355-4642-be3c-a138e9d0177f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.305259 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.305182    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:10.316045 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.315974    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jqw6\" (UniqueName: \"kubernetes.io/projected/a47e1366-a355-4642-be3c-a138e9d0177f-kube-api-access-6jqw6\") pod \"kuadrant-console-plugin-66c4fb575d-zkdfp\" (UID: \"a47e1366-a355-4642-be3c-a138e9d0177f\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.373960 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.373918    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"
Nov 02 13:49:10.538295 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.538258    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:10.662522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.662493    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp"]
Nov 02 13:49:10.664897 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:49:10.664867    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda47e1366_a355_4642_be3c_a138e9d0177f.slice/crio-7183e35cfc4de1fd7e8eac17825d33a16e039804f7b35a7f283e1e2ab5501196 WatchSource:0}: Error finding container 7183e35cfc4de1fd7e8eac17825d33a16e039804f7b35a7f283e1e2ab5501196: Status 404 returned error can't find the container with id 7183e35cfc4de1fd7e8eac17825d33a16e039804f7b35a7f283e1e2ab5501196
Nov 02 13:49:10.674844 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.674813    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp" event={"ID":"a47e1366-a355-4642-be3c-a138e9d0177f","Type":"ContainerStarted","Data":"7183e35cfc4de1fd7e8eac17825d33a16e039804f7b35a7f283e1e2ab5501196"}
Nov 02 13:49:10.764160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:10.764123    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:13.247752 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:13.247716    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:13.396744 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:13.396709    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:13.554667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:13.554633    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:15.719028 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:15.718919    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp" event={"ID":"a47e1366-a355-4642-be3c-a138e9d0177f","Type":"ContainerStarted","Data":"595e7dd2ce7a053bade7ea72e23d6b3d1cfd9642e28ded38d6f766771e1aa222"}
Nov 02 13:49:15.741480 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:15.741424    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-zkdfp" podStartSLOduration=0.987754396 podStartE2EDuration="5.741409229s" totalImagesPullingTime="4.753654833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:15.740385344 +0000 UTC m=+334.821530464" watchObservedRunningTime="2026-11-02 13:49:15.741409229 +0000 UTC m=+334.822554347"
Nov 02 13:49:16.284405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.284369    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:16.538669 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.538560    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:16.750547 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.750506    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fb985f76c-l524w"]
Nov 02 13:49:16.756953 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.756925    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.776008 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.775972    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 02 13:49:16.776008 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.775984    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 02 13:49:16.796238 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.796157    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fb985f76c-l524w"]
Nov 02 13:49:16.833319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.833287    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:16.839272 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.839243    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 02 13:49:16.839469 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.839296    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8jv2k\""
Nov 02 13:49:16.839673 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.839647    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 02 13:49:16.858479 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.858439    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-tmp\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.858479 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.858483    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-tls-certs\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.858714 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.858513    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwbp\" (UniqueName: \"kubernetes.io/projected/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-kube-api-access-qhwbp\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.959543 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.959506    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwbp\" (UniqueName: \"kubernetes.io/projected/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-kube-api-access-qhwbp\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.959761 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.959567    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-tmp\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.959761 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.959597    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-tls-certs\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.962130 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.962100    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-tmp\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:16.962538 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:16.962516    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-tls-certs\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:17.010809 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.010778    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwbp\" (UniqueName: \"kubernetes.io/projected/c1c465e1-dd6c-4dc3-8951-1e81c9598e27-kube-api-access-qhwbp\") pod \"kube-auth-proxy-fb985f76c-l524w\" (UID: \"c1c465e1-dd6c-4dc3-8951-1e81c9598e27\") " pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:17.072522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.072429    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w"
Nov 02 13:49:17.287077 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.287036    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:17.385167 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.385060    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fb985f76c-l524w"]
Nov 02 13:49:17.389595 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:49:17.389562    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c465e1_dd6c_4dc3_8951_1e81c9598e27.slice/crio-9a08cb5600c36bde022c4c3a93da9f6508aabafc28a920ef8c4c3f63951210f6 WatchSource:0}: Error finding container 9a08cb5600c36bde022c4c3a93da9f6508aabafc28a920ef8c4c3f63951210f6: Status 404 returned error can't find the container with id 9a08cb5600c36bde022c4c3a93da9f6508aabafc28a920ef8c4c3f63951210f6
Nov 02 13:49:17.572676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.572631    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:17.733813 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.733717    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w" event={"ID":"c1c465e1-dd6c-4dc3-8951-1e81c9598e27","Type":"ContainerStarted","Data":"9a08cb5600c36bde022c4c3a93da9f6508aabafc28a920ef8c4c3f63951210f6"}
Nov 02 13:49:17.776785 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.776639    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:17.952878 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:17.952847    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:18.644132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.644095    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-8zl2d"]
Nov 02 13:49:18.648058 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.648027    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d"
Nov 02 13:49:18.668897 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.668861    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r66x9\""
Nov 02 13:49:18.677475 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.677360    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-8zl2d"]
Nov 02 13:49:18.677851 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.677783    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:18.678202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.678177    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pjz8\" (UniqueName: \"kubernetes.io/projected/5c74809b-4b0c-49e7-baaa-170cae2de01c-kube-api-access-4pjz8\") pod \"authorino-56c6c9ddd5-8zl2d\" (UID: \"5c74809b-4b0c-49e7-baaa-170cae2de01c\") " pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d"
Nov 02 13:49:18.779555 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.779518    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pjz8\" (UniqueName: \"kubernetes.io/projected/5c74809b-4b0c-49e7-baaa-170cae2de01c-kube-api-access-4pjz8\") pod \"authorino-56c6c9ddd5-8zl2d\" (UID: \"5c74809b-4b0c-49e7-baaa-170cae2de01c\") " pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d"
Nov 02 13:49:18.796900 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.796865    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pjz8\" (UniqueName: \"kubernetes.io/projected/5c74809b-4b0c-49e7-baaa-170cae2de01c-kube-api-access-4pjz8\") pod \"authorino-56c6c9ddd5-8zl2d\" (UID: \"5c74809b-4b0c-49e7-baaa-170cae2de01c\") " pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d"
Nov 02 13:49:18.825041 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.824580    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:18.963649 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:18.963555    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d"
Nov 02 13:49:19.250556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:19.250519    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-8zl2d"]
Nov 02 13:49:19.252312 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:49:19.252278    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c74809b_4b0c_49e7_baaa_170cae2de01c.slice/crio-91e094f6cf7d9b384db45c4d188aba0ed53dc4b642f523efe80912dbb2e448ac WatchSource:0}: Error finding container 91e094f6cf7d9b384db45c4d188aba0ed53dc4b642f523efe80912dbb2e448ac: Status 404 returned error can't find the container with id 91e094f6cf7d9b384db45c4d188aba0ed53dc4b642f523efe80912dbb2e448ac
Nov 02 13:49:19.702722 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:19.702602    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:19.752208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:19.752173    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d" event={"ID":"5c74809b-4b0c-49e7-baaa-170cae2de01c","Type":"ContainerStarted","Data":"91e094f6cf7d9b384db45c4d188aba0ed53dc4b642f523efe80912dbb2e448ac"}
Nov 02 13:49:19.852108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:19.846556    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:20.249562 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:20.249496    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:20.399739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:20.399690    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:20.680227 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:20.678552    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 13:49:21.764693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:21.764659    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d" event={"ID":"5c74809b-4b0c-49e7-baaa-170cae2de01c","Type":"ContainerStarted","Data":"1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a"}
Nov 02 13:49:21.801803 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:21.801751    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d" podStartSLOduration=1.8250815299999998 podStartE2EDuration="3.801735848s" totalImagesPullingTime="1.976654318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:21.799994609 +0000 UTC m=+340.881139729" watchObservedRunningTime="2026-11-02 13:49:21.801735848 +0000 UTC m=+340.882880966"
Nov 02 13:49:23.777380 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:23.777314    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w" event={"ID":"c1c465e1-dd6c-4dc3-8951-1e81c9598e27","Type":"ContainerStarted","Data":"1b933b06e26e4af3d8121e09455df4b7ec375193665dde1e4553d0bbf01a2c5a"}
Nov 02 13:49:23.823273 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:23.823205    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fb985f76c-l524w" podStartSLOduration=1.942531708 podStartE2EDuration="7.823189588s" totalImagesPullingTime="5.88065788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:23.818837832 +0000 UTC m=+342.899982951" watchObservedRunningTime="2026-11-02 13:49:23.823189588 +0000 UTC m=+342.904334705"
Nov 02 13:49:24.992773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:24.992737    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:25.160139 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:25.160105    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:31.479603 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:31.479570    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:31.623560 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:31.623530    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:34.075970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:34.075935    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:34.233561 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:34.233523    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:36.083086 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:49:36.083039    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:49:37.632592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:37.632555    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:37.797396 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:37.797359    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:37.931895 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:37.931807    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:38.068389 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:38.068346    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:38.282479 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:38.282449    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:38.435095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:38.435037    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:39.212566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:39.212535    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:39.355209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:39.355164    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:40.020170 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:40.020135    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:44.628257 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:44.628214    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:44.764289 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:44.764253    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:51.063175 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:51.063087    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:51.196442 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:51.196408    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:49:51.573769 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:49:51.573736    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:04.055547 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:04.055511    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:04.186836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:04.186781    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:06.083229 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:50:06.083182    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:50:09.935970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:09.935934    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:10.233119 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.232986    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:10.368333 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.368297    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:10.417477 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.417443    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b76f98b8f-7qg57"]
Nov 02 13:50:10.424434 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.424404    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.428556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.428524    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 02 13:50:10.428556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.428556    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 02 13:50:10.431670 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.431647    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 02 13:50:10.431829 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.431680    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 02 13:50:10.432208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.432184    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 02 13:50:10.434457 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.434437    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b76f98b8f-7qg57"]
Nov 02 13:50:10.532035 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.532011    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8n6b9\""
Nov 02 13:50:10.541442 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.541417    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-metrics-certs\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.541525 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.541469    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-webhook-cert\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.541525 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.541495    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp2km\" (UniqueName: \"kubernetes.io/projected/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-kube-api-access-lp2km\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.642232 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.642188    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-webhook-cert\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.642232 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.642235    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp2km\" (UniqueName: \"kubernetes.io/projected/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-kube-api-access-lp2km\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.642514 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.642279    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-metrics-certs\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.645195 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.645166    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-webhook-cert\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.645317 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.645166    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-metrics-certs\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.661988 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.661957    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp2km\" (UniqueName: \"kubernetes.io/projected/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-kube-api-access-lp2km\") pod \"maas-controller-7b76f98b8f-7qg57\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") " pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:10.738401 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:10.738364    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:11.022504 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:11.022456    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b76f98b8f-7qg57"]
Nov 02 13:50:11.025450 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:50:11.025420    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40382da8_1f0b_4e9d_bee8_ae2d0e8b7459.slice/crio-7e2b75069b9a74d38b7b75ac75dc29349b1d28bb32ffc0b28701f43d9353c818 WatchSource:0}: Error finding container 7e2b75069b9a74d38b7b75ac75dc29349b1d28bb32ffc0b28701f43d9353c818: Status 404 returned error can't find the container with id 7e2b75069b9a74d38b7b75ac75dc29349b1d28bb32ffc0b28701f43d9353c818
Nov 02 13:50:12.022819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:12.022778    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b76f98b8f-7qg57" event={"ID":"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459","Type":"ContainerStarted","Data":"7e2b75069b9a74d38b7b75ac75dc29349b1d28bb32ffc0b28701f43d9353c818"}
Nov 02 13:50:13.652454 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.652415    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:13.781305 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.781263    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"]
Nov 02 13:50:13.785465 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.785441    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:13.804286 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.804253    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"]
Nov 02 13:50:13.816193 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.816163    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xtpsc\""
Nov 02 13:50:13.816572 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.816549    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 02 13:50:13.826840 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.826583    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:13.879314 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.879277    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27466fcc-8e06-43b0-8462-a13c376c1237-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-v77h4\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:13.879511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.879343    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rlrz\" (UniqueName: \"kubernetes.io/projected/27466fcc-8e06-43b0-8462-a13c376c1237-kube-api-access-4rlrz\") pod \"llmisvc-controller-manager-869d5dcc5d-v77h4\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:13.980455 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.980339    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rlrz\" (UniqueName: \"kubernetes.io/projected/27466fcc-8e06-43b0-8462-a13c376c1237-kube-api-access-4rlrz\") pod \"llmisvc-controller-manager-869d5dcc5d-v77h4\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:13.980455 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.980441    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27466fcc-8e06-43b0-8462-a13c376c1237-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-v77h4\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:13.983464 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.983439    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27466fcc-8e06-43b0-8462-a13c376c1237-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-v77h4\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:13.991703 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.991666    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:13.995185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:13.995160    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rlrz\" (UniqueName: \"kubernetes.io/projected/27466fcc-8e06-43b0-8462-a13c376c1237-kube-api-access-4rlrz\") pod \"llmisvc-controller-manager-869d5dcc5d-v77h4\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:14.036593 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:14.036543    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b76f98b8f-7qg57" event={"ID":"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459","Type":"ContainerStarted","Data":"da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584"}
Nov 02 13:50:14.036890 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:14.036720    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:14.065277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:14.065197    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7b76f98b8f-7qg57" podStartSLOduration=1.2876405659999999 podStartE2EDuration="4.065173255s" totalImagesPullingTime="2.777532689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:50:14.063277298 +0000 UTC m=+393.144422420" watchObservedRunningTime="2026-11-02 13:50:14.065173255 +0000 UTC m=+393.146318374"
Nov 02 13:50:14.099307 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:14.099254    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:14.127469 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:14.127437    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:14.384473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:14.384332    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"]
Nov 02 13:50:14.387840 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:50:14.387802    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27466fcc_8e06_43b0_8462_a13c376c1237.slice/crio-507cb9ad14d185b2ce326d3ef329656f59a0347cba0f663d7661d488253561b0 WatchSource:0}: Error finding container 507cb9ad14d185b2ce326d3ef329656f59a0347cba0f663d7661d488253561b0: Status 404 returned error can't find the container with id 507cb9ad14d185b2ce326d3ef329656f59a0347cba0f663d7661d488253561b0
Nov 02 13:50:15.044825 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:15.044788    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4" event={"ID":"27466fcc-8e06-43b0-8462-a13c376c1237","Type":"ContainerStarted","Data":"507cb9ad14d185b2ce326d3ef329656f59a0347cba0f663d7661d488253561b0"}
Nov 02 13:50:15.498336 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:15.498256    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:15.637418 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:15.637380    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:15.873242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:15.873199    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:17.056462 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:17.056431    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4" event={"ID":"27466fcc-8e06-43b0-8462-a13c376c1237","Type":"ContainerStarted","Data":"7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8"}
Nov 02 13:50:17.056938 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:17.056590    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:17.083169 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:17.083112    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4" podStartSLOduration=2.039430165 podStartE2EDuration="4.083096818s" totalImagesPullingTime="2.043666653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:50:17.082364043 +0000 UTC m=+396.163509160" watchObservedRunningTime="2026-11-02 13:50:17.083096818 +0000 UTC m=+396.164241936"
Nov 02 13:50:17.282898 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:17.282842    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:17.409392 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:17.409304    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:23.365446 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:23.365410    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:23.595355 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:23.595303    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:25.046291 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:25.046260    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 13:50:36.083330 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:50:36.083290    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:50:45.995661 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:45.995620    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:46.132288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:46.132240    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:47.382647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.382611    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:47.503737 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.503692    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"]
Nov 02 13:50:47.508764 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.508735    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.517360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.517332    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 13:50:47.519558 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.519528    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 13:50:47.519707 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.519563    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7dtkz\""
Nov 02 13:50:47.519707 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.519614    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 02 13:50:47.519707 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.519682    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 13:50:47.521950 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.521923    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"]
Nov 02 13:50:47.529397 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.529339    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:47.606370 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.606335    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bf8s\" (UniqueName: \"kubernetes.io/projected/1861001e-041c-4199-9188-392a640b9fe1-kube-api-access-8bf8s\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.606556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.606380    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1861001e-041c-4199-9188-392a640b9fe1-openshift-service-ca\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.606556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.606523    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-metrics-certs\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.606629 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.606565    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-maas-api-tls\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.660015 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.659918    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:47.707764 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.707729    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bf8s\" (UniqueName: \"kubernetes.io/projected/1861001e-041c-4199-9188-392a640b9fe1-kube-api-access-8bf8s\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.707952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.707775    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1861001e-041c-4199-9188-392a640b9fe1-openshift-service-ca\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.707952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.707828    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-metrics-certs\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.707952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.707848    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-maas-api-tls\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.708591 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.708566    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1861001e-041c-4199-9188-392a640b9fe1-openshift-service-ca\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.710587 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.710566    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-metrics-certs\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.710690 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.710671    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-maas-api-tls\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.720617 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.720583    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bf8s\" (UniqueName: \"kubernetes.io/projected/1861001e-041c-4199-9188-392a640b9fe1-kube-api-access-8bf8s\") pod \"maas-api-6d669c7fcd-m6xcd\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:47.822909 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:47.822876    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:48.066409 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:48.066373    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:50:48.111148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:48.111089    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"]
Nov 02 13:50:48.220392 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:48.220345    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd" event={"ID":"1861001e-041c-4199-9188-392a640b9fe1","Type":"ContainerStarted","Data":"2bba60adcaa10481644239d58c38f3ac8ce781aca76ea5eda1a3803d459b8500"}
Nov 02 13:50:50.231812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:50.231768    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd" event={"ID":"1861001e-041c-4199-9188-392a640b9fe1","Type":"ContainerStarted","Data":"7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842"}
Nov 02 13:50:50.232261 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:50.231859    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:50.253379 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:50.253327    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd" podStartSLOduration=1.349709103 podStartE2EDuration="3.253311769s" totalImagesPullingTime="1.903602666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:50:50.252792679 +0000 UTC m=+429.333937799" watchObservedRunningTime="2026-11-02 13:50:50.253311769 +0000 UTC m=+429.334456887"
Nov 02 13:50:51.627548 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:51.627506    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:56.242542 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:56.242513    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:50:56.739610 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:56.739575    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:56.882091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:56.882016    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:50:57.165483 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.165447    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cklnt"]
Nov 02 13:50:57.169189 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.169157    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.177225 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.177180    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cklnt"]
Nov 02 13:50:57.179463 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.179426    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 02 13:50:57.195120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.194922    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xnbb\" (UniqueName: \"kubernetes.io/projected/1004ddc7-f2ae-4637-9844-5764a7243c36-kube-api-access-6xnbb\") pod \"authorino-6889cbd8c4-cklnt\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") " pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.195120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.194994    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1004ddc7-f2ae-4637-9844-5764a7243c36-tls-cert\") pod \"authorino-6889cbd8c4-cklnt\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") " pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.295545 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.295510    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xnbb\" (UniqueName: \"kubernetes.io/projected/1004ddc7-f2ae-4637-9844-5764a7243c36-kube-api-access-6xnbb\") pod \"authorino-6889cbd8c4-cklnt\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") " pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.295992 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.295568    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1004ddc7-f2ae-4637-9844-5764a7243c36-tls-cert\") pod \"authorino-6889cbd8c4-cklnt\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") " pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.298398 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.298372    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1004ddc7-f2ae-4637-9844-5764a7243c36-tls-cert\") pod \"authorino-6889cbd8c4-cklnt\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") " pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.308290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.308264    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xnbb\" (UniqueName: \"kubernetes.io/projected/1004ddc7-f2ae-4637-9844-5764a7243c36-kube-api-access-6xnbb\") pod \"authorino-6889cbd8c4-cklnt\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") " pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.388622 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.388578    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cklnt"]
Nov 02 13:50:57.388833 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.388822    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:57.484514 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.484482    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-576ff5949d-xq89w"]
Nov 02 13:50:57.488032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.488013    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:57.496563 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.496537    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94687\" (UniqueName: \"kubernetes.io/projected/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-kube-api-access-94687\") pod \"authorino-576ff5949d-xq89w\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") " pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:57.496680 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.496623    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-tls-cert\") pod \"authorino-576ff5949d-xq89w\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") " pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:57.507893 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.507860    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-576ff5949d-xq89w"]
Nov 02 13:50:57.597429 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.597392    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94687\" (UniqueName: \"kubernetes.io/projected/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-kube-api-access-94687\") pod \"authorino-576ff5949d-xq89w\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") " pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:57.597623 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.597459    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-tls-cert\") pod \"authorino-576ff5949d-xq89w\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") " pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:57.600253 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.600217    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-tls-cert\") pod \"authorino-576ff5949d-xq89w\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") " pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:57.610118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.610082    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94687\" (UniqueName: \"kubernetes.io/projected/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-kube-api-access-94687\") pod \"authorino-576ff5949d-xq89w\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") " pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:57.669542 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.669511    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cklnt"]
Nov 02 13:50:57.671998 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:50:57.671964    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1004ddc7_f2ae_4637_9844_5764a7243c36.slice/crio-05acd39535e42874f3be98eb13f43918051898f756c12209f934f7909c5b3a6b WatchSource:0}: Error finding container 05acd39535e42874f3be98eb13f43918051898f756c12209f934f7909c5b3a6b: Status 404 returned error can't find the container with id 05acd39535e42874f3be98eb13f43918051898f756c12209f934f7909c5b3a6b
Nov 02 13:50:57.800884 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:57.800846    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:50:58.080348 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:58.080275    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-576ff5949d-xq89w"]
Nov 02 13:50:58.083486 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:50:58.083443    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76395b69_e730_4ec5_8a2a_9ae1f1f2dbdc.slice/crio-6b994532798ef1454fa019b885e8c941b2692e6a1533da78ef30dabb0127648e WatchSource:0}: Error finding container 6b994532798ef1454fa019b885e8c941b2692e6a1533da78ef30dabb0127648e: Status 404 returned error can't find the container with id 6b994532798ef1454fa019b885e8c941b2692e6a1533da78ef30dabb0127648e
Nov 02 13:50:58.274029 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:58.273985    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-cklnt" event={"ID":"1004ddc7-f2ae-4637-9844-5764a7243c36","Type":"ContainerStarted","Data":"05acd39535e42874f3be98eb13f43918051898f756c12209f934f7909c5b3a6b"}
Nov 02 13:50:58.275419 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:58.275390    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576ff5949d-xq89w" event={"ID":"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc","Type":"ContainerStarted","Data":"6b994532798ef1454fa019b885e8c941b2692e6a1533da78ef30dabb0127648e"}
Nov 02 13:50:59.281963 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.281924    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-cklnt" event={"ID":"1004ddc7-f2ae-4637-9844-5764a7243c36","Type":"ContainerStarted","Data":"04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219"}
Nov 02 13:50:59.282463 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.282008    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-cklnt" podUID="1004ddc7-f2ae-4637-9844-5764a7243c36" containerName="authorino" containerID="cri-o://04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219" gracePeriod=30
Nov 02 13:50:59.300695 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.300645    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-cklnt" podStartSLOduration=1.421813311 podStartE2EDuration="2.300628275s" totalImagesPullingTime="878.814964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:50:59.299054919 +0000 UTC m=+438.380200040" watchObservedRunningTime="2026-11-02 13:50:59.300628275 +0000 UTC m=+438.381773393"
Nov 02 13:50:59.549061 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.548970    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:50:59.615240 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.615192    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1004ddc7-f2ae-4637-9844-5764a7243c36-tls-cert\" (UniqueName: \"kubernetes.io/secret/1004ddc7-f2ae-4637-9844-5764a7243c36-tls-cert\") pod \"1004ddc7-f2ae-4637-9844-5764a7243c36\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") "
Nov 02 13:50:59.615481 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.615341    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1004ddc7-f2ae-4637-9844-5764a7243c36-kube-api-access-6xnbb\" (UniqueName: \"kubernetes.io/projected/1004ddc7-f2ae-4637-9844-5764a7243c36-kube-api-access-6xnbb\") pod \"1004ddc7-f2ae-4637-9844-5764a7243c36\" (UID: \"1004ddc7-f2ae-4637-9844-5764a7243c36\") "
Nov 02 13:50:59.617798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.617751    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1004ddc7-f2ae-4637-9844-5764a7243c36-kube-api-access-6xnbb" pod "1004ddc7-f2ae-4637-9844-5764a7243c36" (UID: "1004ddc7-f2ae-4637-9844-5764a7243c36"). InnerVolumeSpecName "kube-api-access-6xnbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:50:59.631713 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.631667    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1004ddc7-f2ae-4637-9844-5764a7243c36-tls-cert" pod "1004ddc7-f2ae-4637-9844-5764a7243c36" (UID: "1004ddc7-f2ae-4637-9844-5764a7243c36"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:50:59.716192 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.716152    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xnbb\" (UniqueName: \"kubernetes.io/projected/1004ddc7-f2ae-4637-9844-5764a7243c36-kube-api-access-6xnbb\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:50:59.716192 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:50:59.716192    5453 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1004ddc7-f2ae-4637-9844-5764a7243c36-tls-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:00.288342 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.288301    5453 generic.go:356] "Generic (PLEG): container finished" podID="1004ddc7-f2ae-4637-9844-5764a7243c36" containerID="04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219" exitCode=0
Nov 02 13:51:00.288342 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.288360    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-cklnt"
Nov 02 13:51:00.288987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.288410    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-cklnt" event={"ID":"1004ddc7-f2ae-4637-9844-5764a7243c36","Type":"ContainerDied","Data":"04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219"}
Nov 02 13:51:00.288987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.288469    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-cklnt" event={"ID":"1004ddc7-f2ae-4637-9844-5764a7243c36","Type":"ContainerDied","Data":"05acd39535e42874f3be98eb13f43918051898f756c12209f934f7909c5b3a6b"}
Nov 02 13:51:00.288987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.288496    5453 scope.go:122] "RemoveContainer" containerID="04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219"
Nov 02 13:51:00.290705 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.290658    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576ff5949d-xq89w" event={"ID":"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc","Type":"ContainerStarted","Data":"085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c"}
Nov 02 13:51:00.300588 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.300566    5453 scope.go:122] "RemoveContainer" containerID="04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219"
Nov 02 13:51:00.300929 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:51:00.300907    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219\": container with ID starting with 04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219 not found: ID does not exist" containerID="04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219"
Nov 02 13:51:00.301011 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.300944    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219"} err="failed to get container status \"04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219\": rpc error: code = NotFound desc = could not find container \"04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219\": container with ID starting with 04cbeca4f1e400c82b97a6ef6a86cc2e9e56bdbcdbacea7d77e55338c97fc219 not found: ID does not exist"
Nov 02 13:51:00.310693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.310642    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-576ff5949d-xq89w" podStartSLOduration=2.066366361 podStartE2EDuration="3.310627212s" totalImagesPullingTime="1.244260851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:51:00.310188964 +0000 UTC m=+439.391334089" watchObservedRunningTime="2026-11-02 13:51:00.310627212 +0000 UTC m=+439.391772330"
Nov 02 13:51:00.324685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.324650    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cklnt"]
Nov 02 13:51:00.330725 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.330688    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-cklnt"]
Nov 02 13:51:00.335802 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.335775    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-8zl2d"]
Nov 02 13:51:00.335997 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.335973    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d" podUID="5c74809b-4b0c-49e7-baaa-170cae2de01c" containerName="authorino" containerID="cri-o://1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a" gracePeriod=30
Nov 02 13:51:00.589326 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.589296    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d"
Nov 02 13:51:00.622766 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.622733    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c74809b-4b0c-49e7-baaa-170cae2de01c-kube-api-access-4pjz8\" (UniqueName: \"kubernetes.io/projected/5c74809b-4b0c-49e7-baaa-170cae2de01c-kube-api-access-4pjz8\") pod \"5c74809b-4b0c-49e7-baaa-170cae2de01c\" (UID: \"5c74809b-4b0c-49e7-baaa-170cae2de01c\") "
Nov 02 13:51:00.625331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.625293    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c74809b-4b0c-49e7-baaa-170cae2de01c-kube-api-access-4pjz8" pod "5c74809b-4b0c-49e7-baaa-170cae2de01c" (UID: "5c74809b-4b0c-49e7-baaa-170cae2de01c"). InnerVolumeSpecName "kube-api-access-4pjz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:51:00.724103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:00.724009    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pjz8\" (UniqueName: \"kubernetes.io/projected/5c74809b-4b0c-49e7-baaa-170cae2de01c-kube-api-access-4pjz8\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:01.043814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.043781    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1004ddc7-f2ae-4637-9844-5764a7243c36" path="/var/lib/kubelet/pods/1004ddc7-f2ae-4637-9844-5764a7243c36/volumes"
Nov 02 13:51:01.298475 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.298380    5453 generic.go:356] "Generic (PLEG): container finished" podID="5c74809b-4b0c-49e7-baaa-170cae2de01c" containerID="1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a" exitCode=0
Nov 02 13:51:01.298475 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.298419    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d" event={"ID":"5c74809b-4b0c-49e7-baaa-170cae2de01c","Type":"ContainerDied","Data":"1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a"}
Nov 02 13:51:01.298475 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.298463    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d" event={"ID":"5c74809b-4b0c-49e7-baaa-170cae2de01c","Type":"ContainerDied","Data":"91e094f6cf7d9b384db45c4d188aba0ed53dc4b642f523efe80912dbb2e448ac"}
Nov 02 13:51:01.298996 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.298483    5453 scope.go:122] "RemoveContainer" containerID="1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a"
Nov 02 13:51:01.298996 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.298431    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-8zl2d"
Nov 02 13:51:01.307708 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.307660    5453 scope.go:122] "RemoveContainer" containerID="1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a"
Nov 02 13:51:01.308003 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:51:01.307980    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a\": container with ID starting with 1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a not found: ID does not exist" containerID="1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a"
Nov 02 13:51:01.308063 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.308012    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a"} err="failed to get container status \"1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a\": rpc error: code = NotFound desc = could not find container \"1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a\": container with ID starting with 1e66d1fbb5819e0b8252666796015274cea15b6e8614f3bdada75c3a9a385e5a not found: ID does not exist"
Nov 02 13:51:01.316407 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.316364    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-8zl2d"]
Nov 02 13:51:01.319778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:01.319751    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-8zl2d"]
Nov 02 13:51:03.042565 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:03.042528    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c74809b-4b0c-49e7-baaa-170cae2de01c" path="/var/lib/kubelet/pods/5c74809b-4b0c-49e7-baaa-170cae2de01c/volumes"
Nov 02 13:51:06.082379 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:51:06.082339    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:51:06.856523 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:06.856481    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:07.039336 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:07.039305    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:08.547928 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.547887    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"]
Nov 02 13:51:08.548586 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.548124    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd" podUID="1861001e-041c-4199-9188-392a640b9fe1" containerName="maas-api" containerID="cri-o://7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842" gracePeriod=30
Nov 02 13:51:08.810249 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.810178    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:51:08.886648 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.886612    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1861001e-041c-4199-9188-392a640b9fe1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1861001e-041c-4199-9188-392a640b9fe1-openshift-service-ca\") pod \"1861001e-041c-4199-9188-392a640b9fe1\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") "
Nov 02 13:51:08.886842 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.886679    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1861001e-041c-4199-9188-392a640b9fe1-kube-api-access-8bf8s\" (UniqueName: \"kubernetes.io/projected/1861001e-041c-4199-9188-392a640b9fe1-kube-api-access-8bf8s\") pod \"1861001e-041c-4199-9188-392a640b9fe1\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") "
Nov 02 13:51:08.886842 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.886710    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-maas-api-tls\") pod \"1861001e-041c-4199-9188-392a640b9fe1\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") "
Nov 02 13:51:08.886842 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.886730    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-metrics-certs\") pod \"1861001e-041c-4199-9188-392a640b9fe1\" (UID: \"1861001e-041c-4199-9188-392a640b9fe1\") "
Nov 02 13:51:08.887119 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.887052    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1861001e-041c-4199-9188-392a640b9fe1-openshift-service-ca" pod "1861001e-041c-4199-9188-392a640b9fe1" (UID: "1861001e-041c-4199-9188-392a640b9fe1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:51:08.889358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.889326    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-metrics-certs" pod "1861001e-041c-4199-9188-392a640b9fe1" (UID: "1861001e-041c-4199-9188-392a640b9fe1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:51:08.889500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.889353    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-maas-api-tls" pod "1861001e-041c-4199-9188-392a640b9fe1" (UID: "1861001e-041c-4199-9188-392a640b9fe1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:51:08.889500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.889389    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1861001e-041c-4199-9188-392a640b9fe1-kube-api-access-8bf8s" pod "1861001e-041c-4199-9188-392a640b9fe1" (UID: "1861001e-041c-4199-9188-392a640b9fe1"). InnerVolumeSpecName "kube-api-access-8bf8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:51:08.988037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.987992    5453 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1861001e-041c-4199-9188-392a640b9fe1-openshift-service-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:08.988037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.988030    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bf8s\" (UniqueName: \"kubernetes.io/projected/1861001e-041c-4199-9188-392a640b9fe1-kube-api-access-8bf8s\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:08.988037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.988041    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-maas-api-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:08.988332 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:08.988050    5453 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1861001e-041c-4199-9188-392a640b9fe1-metrics-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:09.341417 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.341380    5453 generic.go:356] "Generic (PLEG): container finished" podID="1861001e-041c-4199-9188-392a640b9fe1" containerID="7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842" exitCode=0
Nov 02 13:51:09.341417 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.341426    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"
Nov 02 13:51:09.341681 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.341464    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd" event={"ID":"1861001e-041c-4199-9188-392a640b9fe1","Type":"ContainerDied","Data":"7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842"}
Nov 02 13:51:09.341681 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.341521    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd" event={"ID":"1861001e-041c-4199-9188-392a640b9fe1","Type":"ContainerDied","Data":"2bba60adcaa10481644239d58c38f3ac8ce781aca76ea5eda1a3803d459b8500"}
Nov 02 13:51:09.341681 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.341544    5453 scope.go:122] "RemoveContainer" containerID="7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842"
Nov 02 13:51:09.351881 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.351860    5453 scope.go:122] "RemoveContainer" containerID="7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842"
Nov 02 13:51:09.352290 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:51:09.352268    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842\": container with ID starting with 7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842 not found: ID does not exist" containerID="7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842"
Nov 02 13:51:09.352349 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.352301    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842"} err="failed to get container status \"7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842\": rpc error: code = NotFound desc = could not find container \"7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842\": container with ID starting with 7e29c334c176413e906aa30ea3ef8452d23d426b9b50b7350e3c178221bd5842 not found: ID does not exist"
Nov 02 13:51:09.359915 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.359878    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"]
Nov 02 13:51:09.364808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:09.364780    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-m6xcd"]
Nov 02 13:51:11.042507 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:11.042471    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1861001e-041c-4199-9188-392a640b9fe1" path="/var/lib/kubelet/pods/1861001e-041c-4199-9188-392a640b9fe1/volumes"
Nov 02 13:51:15.615796 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:15.615754    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:15.744841 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:15.744806    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:21.381107 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381002    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"]
Nov 02 13:51:21.381494 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381369    5453 cpu_manager.go:414] "containerMap: removing container" podUID="1861001e-041c-4199-9188-392a640b9fe1" containerName="maas-api"
Nov 02 13:51:21.381494 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381381    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1861001e-041c-4199-9188-392a640b9fe1" containerName="maas-api"
Nov 02 13:51:21.381494 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381390    5453 cpu_manager.go:414] "containerMap: removing container" podUID="1004ddc7-f2ae-4637-9844-5764a7243c36" containerName="authorino"
Nov 02 13:51:21.381494 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381395    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1004ddc7-f2ae-4637-9844-5764a7243c36" containerName="authorino"
Nov 02 13:51:21.381494 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381412    5453 cpu_manager.go:414] "containerMap: removing container" podUID="5c74809b-4b0c-49e7-baaa-170cae2de01c" containerName="authorino"
Nov 02 13:51:21.381494 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381418    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c74809b-4b0c-49e7-baaa-170cae2de01c" containerName="authorino"
Nov 02 13:51:21.381670 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381497    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="1861001e-041c-4199-9188-392a640b9fe1" containerName="maas-api"
Nov 02 13:51:21.381670 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381508    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="1004ddc7-f2ae-4637-9844-5764a7243c36" containerName="authorino"
Nov 02 13:51:21.381670 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.381520    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c74809b-4b0c-49e7-baaa-170cae2de01c" containerName="authorino"
Nov 02 13:51:21.384953 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.384929    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.395051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.395023    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"]
Nov 02 13:51:21.503927 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.503875    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfz9x\" (UniqueName: \"kubernetes.io/projected/e82d547c-4105-4576-ac9b-ffe39b1fe222-kube-api-access-qfz9x\") pod \"llmisvc-controller-manager-6466c554d8-lckhh\" (UID: \"e82d547c-4105-4576-ac9b-ffe39b1fe222\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.504166 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.504011    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82d547c-4105-4576-ac9b-ffe39b1fe222-cert\") pod \"llmisvc-controller-manager-6466c554d8-lckhh\" (UID: \"e82d547c-4105-4576-ac9b-ffe39b1fe222\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.604595 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.604551    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82d547c-4105-4576-ac9b-ffe39b1fe222-cert\") pod \"llmisvc-controller-manager-6466c554d8-lckhh\" (UID: \"e82d547c-4105-4576-ac9b-ffe39b1fe222\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.604749 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.604607    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfz9x\" (UniqueName: \"kubernetes.io/projected/e82d547c-4105-4576-ac9b-ffe39b1fe222-kube-api-access-qfz9x\") pod \"llmisvc-controller-manager-6466c554d8-lckhh\" (UID: \"e82d547c-4105-4576-ac9b-ffe39b1fe222\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.607297 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.607249    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82d547c-4105-4576-ac9b-ffe39b1fe222-cert\") pod \"llmisvc-controller-manager-6466c554d8-lckhh\" (UID: \"e82d547c-4105-4576-ac9b-ffe39b1fe222\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.617940 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.617906    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfz9x\" (UniqueName: \"kubernetes.io/projected/e82d547c-4105-4576-ac9b-ffe39b1fe222-kube-api-access-qfz9x\") pod \"llmisvc-controller-manager-6466c554d8-lckhh\" (UID: \"e82d547c-4105-4576-ac9b-ffe39b1fe222\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.698442 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.698339    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:21.977429 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:21.977399    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"]
Nov 02 13:51:21.979695 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:51:21.979665    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82d547c_4105_4576_ac9b_ffe39b1fe222.slice/crio-810edb8d5b8067b5f9883564f4cf37a3d0354a8ea59092f261083fbad80a78d3 WatchSource:0}: Error finding container 810edb8d5b8067b5f9883564f4cf37a3d0354a8ea59092f261083fbad80a78d3: Status 404 returned error can't find the container with id 810edb8d5b8067b5f9883564f4cf37a3d0354a8ea59092f261083fbad80a78d3
Nov 02 13:51:22.411195 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:22.411157    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh" event={"ID":"e82d547c-4105-4576-ac9b-ffe39b1fe222","Type":"ContainerStarted","Data":"810edb8d5b8067b5f9883564f4cf37a3d0354a8ea59092f261083fbad80a78d3"}
Nov 02 13:51:23.417970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:23.417931    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh" event={"ID":"e82d547c-4105-4576-ac9b-ffe39b1fe222","Type":"ContainerStarted","Data":"6de6ce4f07b991b6e80463a1a6efa5457c773e59ff4167d237c24304b19c898e"}
Nov 02 13:51:23.418497 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:23.418092    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:23.439478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:23.439420    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh" podStartSLOduration=2.004151838 podStartE2EDuration="2.439404534s" totalImagesPullingTime="435.252696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:51:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:51:23.437175942 +0000 UTC m=+462.518321061" watchObservedRunningTime="2026-11-02 13:51:23.439404534 +0000 UTC m=+462.520549653"
Nov 02 13:51:36.083957 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:51:36.083911    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:51:49.261794 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:49.261756    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:51.691759 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:51.691715    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:54.426523 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.426491    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-lckhh"
Nov 02 13:51:54.476034 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.476001    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"]
Nov 02 13:51:54.476280 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.476247    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4" podUID="27466fcc-8e06-43b0-8462-a13c376c1237" containerName="manager" containerID="cri-o://7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8" gracePeriod=30
Nov 02 13:51:54.727321 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.727295    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:51:54.810199 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.810161    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27466fcc-8e06-43b0-8462-a13c376c1237-cert\" (UniqueName: \"kubernetes.io/secret/27466fcc-8e06-43b0-8462-a13c376c1237-cert\") pod \"27466fcc-8e06-43b0-8462-a13c376c1237\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") "
Nov 02 13:51:54.810385 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.810237    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27466fcc-8e06-43b0-8462-a13c376c1237-kube-api-access-4rlrz\" (UniqueName: \"kubernetes.io/projected/27466fcc-8e06-43b0-8462-a13c376c1237-kube-api-access-4rlrz\") pod \"27466fcc-8e06-43b0-8462-a13c376c1237\" (UID: \"27466fcc-8e06-43b0-8462-a13c376c1237\") "
Nov 02 13:51:54.812738 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.812704    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27466fcc-8e06-43b0-8462-a13c376c1237-cert" pod "27466fcc-8e06-43b0-8462-a13c376c1237" (UID: "27466fcc-8e06-43b0-8462-a13c376c1237"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:51:54.812872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.812730    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27466fcc-8e06-43b0-8462-a13c376c1237-kube-api-access-4rlrz" pod "27466fcc-8e06-43b0-8462-a13c376c1237" (UID: "27466fcc-8e06-43b0-8462-a13c376c1237"). InnerVolumeSpecName "kube-api-access-4rlrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:51:54.911388 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.911345    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rlrz\" (UniqueName: \"kubernetes.io/projected/27466fcc-8e06-43b0-8462-a13c376c1237-kube-api-access-4rlrz\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:54.911388 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:54.911382    5453 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27466fcc-8e06-43b0-8462-a13c376c1237-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:51:55.340428 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.340334    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:55.492619 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.492587    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:51:55.575513 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.575475    5453 generic.go:356] "Generic (PLEG): container finished" podID="27466fcc-8e06-43b0-8462-a13c376c1237" containerID="7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8" exitCode=0
Nov 02 13:51:55.575693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.575529    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"
Nov 02 13:51:55.575693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.575527    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4" event={"ID":"27466fcc-8e06-43b0-8462-a13c376c1237","Type":"ContainerDied","Data":"7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8"}
Nov 02 13:51:55.575693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.575585    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4" event={"ID":"27466fcc-8e06-43b0-8462-a13c376c1237","Type":"ContainerDied","Data":"507cb9ad14d185b2ce326d3ef329656f59a0347cba0f663d7661d488253561b0"}
Nov 02 13:51:55.575693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.575608    5453 scope.go:122] "RemoveContainer" containerID="7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8"
Nov 02 13:51:55.584878 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.584860    5453 scope.go:122] "RemoveContainer" containerID="7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8"
Nov 02 13:51:55.585238 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:51:55.585217    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8\": container with ID starting with 7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8 not found: ID does not exist" containerID="7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8"
Nov 02 13:51:55.585320 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.585253    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8"} err="failed to get container status \"7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8\": rpc error: code = NotFound desc = could not find container \"7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8\": container with ID starting with 7f6517d68a4947255e64fb00ac38cf1a55def4d3fe6b6eb0c003bc070456c3e8 not found: ID does not exist"
Nov 02 13:51:55.594011 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.593942    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"]
Nov 02 13:51:55.596450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:55.596417    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-v77h4"]
Nov 02 13:51:57.044707 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:51:57.044671    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27466fcc-8e06-43b0-8462-a13c376c1237" path="/var/lib/kubelet/pods/27466fcc-8e06-43b0-8462-a13c376c1237/volumes"
Nov 02 13:52:06.083727 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:52:06.083688    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:52:17.456337 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:17.456291    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:19.070503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:19.070432    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:21.768387 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:21.768337    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:24.094001 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:24.093969    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:25.657299 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:25.657265    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:27.123883 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:27.123849    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:28.447578 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:28.447511    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:28.865298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:28.865261    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:29.137525 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:29.137438    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:36.083492 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:52:36.083449    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:52:38.424258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.424218    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d779c7bfc-96jbk"]
Nov 02 13:52:38.424698 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.424577    5453 cpu_manager.go:414] "containerMap: removing container" podUID="27466fcc-8e06-43b0-8462-a13c376c1237" containerName="manager"
Nov 02 13:52:38.424698 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.424590    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27466fcc-8e06-43b0-8462-a13c376c1237" containerName="manager"
Nov 02 13:52:38.424698 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.424662    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="27466fcc-8e06-43b0-8462-a13c376c1237" containerName="manager"
Nov 02 13:52:38.427693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.427670    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:38.440226 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.440186    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d779c7bfc-96jbk"]
Nov 02 13:52:38.614924 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.614861    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ba4e0ea-9138-4006-b98c-aae997efa6f4-tls-cert\") pod \"authorino-d779c7bfc-96jbk\" (UID: \"9ba4e0ea-9138-4006-b98c-aae997efa6f4\") " pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:38.615202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.614953    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vl6h\" (UniqueName: \"kubernetes.io/projected/9ba4e0ea-9138-4006-b98c-aae997efa6f4-kube-api-access-9vl6h\") pod \"authorino-d779c7bfc-96jbk\" (UID: \"9ba4e0ea-9138-4006-b98c-aae997efa6f4\") " pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:38.715957 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.715853    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ba4e0ea-9138-4006-b98c-aae997efa6f4-tls-cert\") pod \"authorino-d779c7bfc-96jbk\" (UID: \"9ba4e0ea-9138-4006-b98c-aae997efa6f4\") " pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:38.715957 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.715945    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vl6h\" (UniqueName: \"kubernetes.io/projected/9ba4e0ea-9138-4006-b98c-aae997efa6f4-kube-api-access-9vl6h\") pod \"authorino-d779c7bfc-96jbk\" (UID: \"9ba4e0ea-9138-4006-b98c-aae997efa6f4\") " pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:38.718863 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.718827    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9ba4e0ea-9138-4006-b98c-aae997efa6f4-tls-cert\") pod \"authorino-d779c7bfc-96jbk\" (UID: \"9ba4e0ea-9138-4006-b98c-aae997efa6f4\") " pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:38.728578 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.728548    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vl6h\" (UniqueName: \"kubernetes.io/projected/9ba4e0ea-9138-4006-b98c-aae997efa6f4-kube-api-access-9vl6h\") pod \"authorino-d779c7bfc-96jbk\" (UID: \"9ba4e0ea-9138-4006-b98c-aae997efa6f4\") " pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:38.752430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:38.752389    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d779c7bfc-96jbk"
Nov 02 13:52:39.040890 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:52:39.040852    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ba4e0ea_9138_4006_b98c_aae997efa6f4.slice/crio-fd92c85eae6897211e3a417ed699fa966f3a2de5d79b6d66ea27264b5c16a472 WatchSource:0}: Error finding container fd92c85eae6897211e3a417ed699fa966f3a2de5d79b6d66ea27264b5c16a472: Status 404 returned error can't find the container with id fd92c85eae6897211e3a417ed699fa966f3a2de5d79b6d66ea27264b5c16a472
Nov 02 13:52:39.045575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:39.045549    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d779c7bfc-96jbk"]
Nov 02 13:52:39.817184 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:39.817144    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d779c7bfc-96jbk" event={"ID":"9ba4e0ea-9138-4006-b98c-aae997efa6f4","Type":"ContainerStarted","Data":"fd92c85eae6897211e3a417ed699fa966f3a2de5d79b6d66ea27264b5c16a472"}
Nov 02 13:52:40.826812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:40.826772    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d779c7bfc-96jbk" event={"ID":"9ba4e0ea-9138-4006-b98c-aae997efa6f4","Type":"ContainerStarted","Data":"e58d10f7aff5642154623a2139316966f59775c38620555435b1b98c683e5954"}
Nov 02 13:52:40.849299 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:40.849233    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-d779c7bfc-96jbk" podStartSLOduration=1.958525774 podStartE2EDuration="2.84921378s" totalImagesPullingTime="890.688006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:40.849045248 +0000 UTC m=+539.930190375" watchObservedRunningTime="2026-11-02 13:52:40.84921378 +0000 UTC m=+539.930358900"
Nov 02 13:52:40.877432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:40.877393    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-576ff5949d-xq89w"]
Nov 02 13:52:40.877653 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:40.877626    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-576ff5949d-xq89w" podUID="76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" containerName="authorino" containerID="cri-o://085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c" gracePeriod=30
Nov 02 13:52:41.144416 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.144374    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:52:41.241544 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.241503    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-tls-cert\" (UniqueName: \"kubernetes.io/secret/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-tls-cert\") pod \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") "
Nov 02 13:52:41.241758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.241567    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-kube-api-access-94687\" (UniqueName: \"kubernetes.io/projected/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-kube-api-access-94687\") pod \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\" (UID: \"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc\") "
Nov 02 13:52:41.244812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.244508    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-kube-api-access-94687" pod "76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" (UID: "76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc"). InnerVolumeSpecName "kube-api-access-94687". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:52:41.256641 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.256585    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-tls-cert" pod "76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" (UID: "76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:52:41.342202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.342162    5453 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-tls-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:52:41.342202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.342204    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94687\" (UniqueName: \"kubernetes.io/projected/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc-kube-api-access-94687\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:52:41.527576 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.527484    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:41.680001 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.679964    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:41.834027 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.833994    5453 generic.go:356] "Generic (PLEG): container finished" podID="76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" containerID="085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c" exitCode=0
Nov 02 13:52:41.834561 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.834061    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-576ff5949d-xq89w"
Nov 02 13:52:41.834561 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.834100    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576ff5949d-xq89w" event={"ID":"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc","Type":"ContainerDied","Data":"085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c"}
Nov 02 13:52:41.834561 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.834151    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-576ff5949d-xq89w" event={"ID":"76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc","Type":"ContainerDied","Data":"6b994532798ef1454fa019b885e8c941b2692e6a1533da78ef30dabb0127648e"}
Nov 02 13:52:41.834561 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.834175    5453 scope.go:122] "RemoveContainer" containerID="085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c"
Nov 02 13:52:41.844520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.844500    5453 scope.go:122] "RemoveContainer" containerID="085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c"
Nov 02 13:52:41.844857 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:52:41.844838    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c\": container with ID starting with 085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c not found: ID does not exist" containerID="085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c"
Nov 02 13:52:41.844949 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.844913    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c"} err="failed to get container status \"085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c\": rpc error: code = NotFound desc = could not find container \"085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c\": container with ID starting with 085e08dce0dbc543d1ea1d2350f48161e203d4c2775b324df6ae75949413e96c not found: ID does not exist"
Nov 02 13:52:41.859090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.859039    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-576ff5949d-xq89w"]
Nov 02 13:52:41.864591 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:41.864558    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-576ff5949d-xq89w"]
Nov 02 13:52:43.042603 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:43.042564    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" path="/var/lib/kubelet/pods/76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc/volumes"
Nov 02 13:52:47.364144 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.364105    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"]
Nov 02 13:52:47.364687 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.364595    5453 cpu_manager.go:414] "containerMap: removing container" podUID="76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" containerName="authorino"
Nov 02 13:52:47.364687 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.364616    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" containerName="authorino"
Nov 02 13:52:47.364797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.364727    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="76395b69-e730-4ec5-8a2a-9ae1f1f2dbdc" containerName="authorino"
Nov 02 13:52:47.369437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.369407    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.394088 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.394015    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"]
Nov 02 13:52:47.395213 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395178    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395232    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395262    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8b648f5-c74b-456d-a0f5-8421e4afb536-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395288    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395320    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl66c\" (UniqueName: \"kubernetes.io/projected/e8b648f5-c74b-456d-a0f5-8421e4afb536-kube-api-access-xl66c\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395369    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395555 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395419    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395555 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395474    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395555 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395506    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.395884 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.395863    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 02 13:52:47.420378 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.420351    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ql6jd\""
Nov 02 13:52:47.428101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.428028    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:47.496265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.495959    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496046    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496146    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496184    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496213    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496249    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496274    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8b648f5-c74b-456d-a0f5-8421e4afb536-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496302    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.496814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.496338    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl66c\" (UniqueName: \"kubernetes.io/projected/e8b648f5-c74b-456d-a0f5-8421e4afb536-kube-api-access-xl66c\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.497315 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.497262    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.498375 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.497845    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.498375 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.498114    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.498574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.498371    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.498997 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.498965    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8b648f5-c74b-456d-a0f5-8421e4afb536-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.502134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.502051    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.502906 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.502879    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.512777 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.512741    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8b648f5-c74b-456d-a0f5-8421e4afb536-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.523656 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.523619    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl66c\" (UniqueName: \"kubernetes.io/projected/e8b648f5-c74b-456d-a0f5-8421e4afb536-kube-api-access-xl66c\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-hw5qn\" (UID: \"e8b648f5-c74b-456d-a0f5-8421e4afb536\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.566441 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.566409    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:47.689925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.689824    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:47.979136 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:47.979016    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"]
Nov 02 13:52:47.983433 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:52:47.983403    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b648f5_c74b_456d_a0f5_8421e4afb536.slice/crio-f28ed898a48ad54fb53f9308a5c9837af59c4a81d1f5feb95a5abb58db6960f3 WatchSource:0}: Error finding container f28ed898a48ad54fb53f9308a5c9837af59c4a81d1f5feb95a5abb58db6960f3: Status 404 returned error can't find the container with id f28ed898a48ad54fb53f9308a5c9837af59c4a81d1f5feb95a5abb58db6960f3
Nov 02 13:52:48.880518 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:48.880481    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" event={"ID":"e8b648f5-c74b-456d-a0f5-8421e4afb536","Type":"ContainerStarted","Data":"f28ed898a48ad54fb53f9308a5c9837af59c4a81d1f5feb95a5abb58db6960f3"}
Nov 02 13:52:51.360366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:51.360329    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:52:51.360682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:51.360402    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:52:51.360682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:51.360432    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:52:51.739925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:51.739820    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:52:51.905283 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:51.905244    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" event={"ID":"e8b648f5-c74b-456d-a0f5-8421e4afb536","Type":"ContainerStarted","Data":"7f53d403a7e5daee8806bfcf0b3da90f99065cc2c1eb2e6ef43f1855a4d49546"}
Nov 02 13:52:51.929701 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:51.929646    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podStartSLOduration=1.5560907099999999 podStartE2EDuration="4.929629279s" totalImagesPullingTime="3.373538569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:51.92853507 +0000 UTC m=+551.009680190" watchObservedRunningTime="2026-11-02 13:52:51.929629279 +0000 UTC m=+551.010774398"
Nov 02 13:52:52.690896 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:52.690853    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:52.692473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:52.692443    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 02 13:52:52.692617 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:52.692503    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 02 13:52:53.691189 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:53.691151    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 02 13:52:53.691605 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:53.691215    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 02 13:52:54.690739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:54.690700    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 02 13:52:54.690954 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:54.690761    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 02 13:52:55.690731 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:55.690691    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 02 13:52:55.691283 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:55.690767    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 02 13:52:56.690574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:56.690536    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 02 13:52:56.690789 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:56.690593    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 02 13:52:57.691266 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:57.691214    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 02 13:52:57.691751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:57.691322    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 02 13:52:58.690706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:58.690658    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Nov 02 13:52:58.690908 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:58.690725    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Nov 02 13:52:59.844776 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:59.844734    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:59.845318 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:59.845285    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:52:59.846322 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:52:59.846289    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn"
Nov 02 13:53:02.355102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.355052    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"]
Nov 02 13:53:02.358751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.358724    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.374235 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.374202    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"]
Nov 02 13:53:02.439521 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439479    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.439521 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439526    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.439811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439547    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.439811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439719    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.439811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439764    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.439973 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439861    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.439973 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439889    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6c7276c-47b7-492f-8eb0-9c3d80797832-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.439973 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439927    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhr2d\" (UniqueName: \"kubernetes.io/projected/f6c7276c-47b7-492f-8eb0-9c3d80797832-kube-api-access-bhr2d\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.440107 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.439997    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.540845 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.540803    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.540861    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.540882    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.540904    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.540919    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6c7276c-47b7-492f-8eb0-9c3d80797832-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.540936    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhr2d\" (UniqueName: \"kubernetes.io/projected/f6c7276c-47b7-492f-8eb0-9c3d80797832-kube-api-access-bhr2d\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.540967    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.541006    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541425 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.541289    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541425 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.541355    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541425 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.541364    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541581 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.541440    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.541660    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.541725 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.541693    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6c7276c-47b7-492f-8eb0-9c3d80797832-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.543818 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.543794    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.543974 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.543953    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.554139 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.554108    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhr2d\" (UniqueName: \"kubernetes.io/projected/f6c7276c-47b7-492f-8eb0-9c3d80797832-kube-api-access-bhr2d\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.554269 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.554200    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6c7276c-47b7-492f-8eb0-9c3d80797832-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-bmx8h\" (UID: \"f6c7276c-47b7-492f-8eb0-9c3d80797832\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.674588 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.674490    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:02.958761 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.958718    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"]
Nov 02 13:53:02.961120 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:53:02.961056    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c7276c_47b7_492f_8eb0_9c3d80797832.slice/crio-7d0fd7f029baf0c07c0a44cb7846cd44fcb4185bf3d0c89953e52854e944637d WatchSource:0}: Error finding container 7d0fd7f029baf0c07c0a44cb7846cd44fcb4185bf3d0c89953e52854e944637d: Status 404 returned error can't find the container with id 7d0fd7f029baf0c07c0a44cb7846cd44fcb4185bf3d0c89953e52854e944637d
Nov 02 13:53:02.969360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.964988    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:02.969360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.965191    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:02.969360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:02.965284    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:03.970591 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:03.970555    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" event={"ID":"f6c7276c-47b7-492f-8eb0-9c3d80797832","Type":"ContainerStarted","Data":"f7ee909f8af28d1241a96a40581830388fef86edca13db1c0a1d551d7e79ea8d"}
Nov 02 13:53:03.971013 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:03.970611    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" event={"ID":"f6c7276c-47b7-492f-8eb0-9c3d80797832","Type":"ContainerStarted","Data":"7d0fd7f029baf0c07c0a44cb7846cd44fcb4185bf3d0c89953e52854e944637d"}
Nov 02 13:53:03.996304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:03.996254    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podStartSLOduration=1.9962355889999999 podStartE2EDuration="1.996235589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:03.994186157 +0000 UTC m=+563.075331277" watchObservedRunningTime="2026-11-02 13:53:03.996235589 +0000 UTC m=+563.077380708"
Nov 02 13:53:04.675049 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:04.675003    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:04.676679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:04.676649    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 02 13:53:04.676822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:04.676702    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 02 13:53:05.675911 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:05.675873    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 02 13:53:05.676413 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:05.675935    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 02 13:53:06.089966 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:53:06.089929    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:53:06.675852 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:06.675812    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 02 13:53:06.676097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:06.675870    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 02 13:53:07.675712 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:07.675666    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 02 13:53:07.675914 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:07.675750    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 02 13:53:08.675653 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:08.675612    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 02 13:53:08.676053 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:08.675671    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 02 13:53:09.675723 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:09.675683    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Nov 02 13:53:09.676155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:09.675749    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Nov 02 13:53:11.412155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:11.412122    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:11.412666 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:11.412628    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:11.413514 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:11.413495    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h"
Nov 02 13:53:13.963661 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:13.963614    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:14.438984 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:14.438934    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:16.062910 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:16.062861    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:16.212909 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:16.212875    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:17.391424 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.391384    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"]
Nov 02 13:53:17.396236 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.396207    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.409119 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.409087    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"]
Nov 02 13:53:17.497847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.497812    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.497847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.497848    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.498134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.497872    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.498134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.497934    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.498134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.498010    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-687k7\" (UniqueName: \"kubernetes.io/projected/d44a11c9-7eec-4447-8899-5df89d8c9923-kube-api-access-687k7\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.498134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.498034    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.498134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.498051    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.498326 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.498140    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.498326 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.498265    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d44a11c9-7eec-4447-8899-5df89d8c9923-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599130 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599046    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-687k7\" (UniqueName: \"kubernetes.io/projected/d44a11c9-7eec-4447-8899-5df89d8c9923-kube-api-access-687k7\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599150    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599179    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599231    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599280    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d44a11c9-7eec-4447-8899-5df89d8c9923-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599331    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599595 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599357    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599595 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599391    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599595 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599426    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599741 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599663    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599744    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.599898 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599872    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.600043 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.599944    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.600221 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.600141    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d44a11c9-7eec-4447-8899-5df89d8c9923-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.601862 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.601833    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.602256 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.602235    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.631760 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.631722    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-687k7\" (UniqueName: \"kubernetes.io/projected/d44a11c9-7eec-4447-8899-5df89d8c9923-kube-api-access-687k7\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.633590 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.633559    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:17.635575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.635550    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d44a11c9-7eec-4447-8899-5df89d8c9923-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-jlgxm\" (UID: \"d44a11c9-7eec-4447-8899-5df89d8c9923\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.711105 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.710989    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:17.783202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:17.783121    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:18.006586 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:18.006559    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"]
Nov 02 13:53:18.008750 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:53:18.008722    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44a11c9_7eec_4447_8899_5df89d8c9923.slice/crio-2d7367d7af477589a5edfd304575f7b88f038b4e3c3df0e5fa19fbe980ad6a1a WatchSource:0}: Error finding container 2d7367d7af477589a5edfd304575f7b88f038b4e3c3df0e5fa19fbe980ad6a1a: Status 404 returned error can't find the container with id 2d7367d7af477589a5edfd304575f7b88f038b4e3c3df0e5fa19fbe980ad6a1a
Nov 02 13:53:18.010981 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:18.010943    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:18.011043 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:18.011022    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:18.011094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:18.011053    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:18.046661 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:18.046620    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" event={"ID":"d44a11c9-7eec-4447-8899-5df89d8c9923","Type":"ContainerStarted","Data":"2d7367d7af477589a5edfd304575f7b88f038b4e3c3df0e5fa19fbe980ad6a1a"}
Nov 02 13:53:19.068393 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:19.068356    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" event={"ID":"d44a11c9-7eec-4447-8899-5df89d8c9923","Type":"ContainerStarted","Data":"8dbe69c9d7db050b9995aedcc356e7a24b8a02ec35aa25f835c4c58d7197205a"}
Nov 02 13:53:19.095202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:19.095149    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podStartSLOduration=2.095134171 podStartE2EDuration="2.095134171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:19.094000347 +0000 UTC m=+578.175145469" watchObservedRunningTime="2026-11-02 13:53:19.095134171 +0000 UTC m=+578.176279282"
Nov 02 13:53:19.712081 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:19.712025    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:19.713703 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:19.713673    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 02 13:53:19.713843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:19.713726    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 02 13:53:20.711886 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:20.711814    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 02 13:53:20.711886 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:20.711873    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 02 13:53:21.712296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:21.712254    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 02 13:53:21.712708 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:21.712315    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 02 13:53:22.712134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:22.712056    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 02 13:53:22.712342 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:22.712175    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 02 13:53:22.794190 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:22.794159    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:22.934456 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:22.934425    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:23.711562 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:23.711517    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 02 13:53:23.711785 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:23.711590    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 02 13:53:24.711893 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:24.711854    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 02 13:53:24.712336 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:24.711911    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 02 13:53:25.711947 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:25.711906    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 02 13:53:25.712393 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:25.711972    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 02 13:53:26.716014 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:26.715981    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:26.716537 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:26.716387    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:26.717244 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:26.717226    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm"
Nov 02 13:53:36.083316 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:53:36.083275    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:53:49.343958 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:49.343921    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:49.481815 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:49.481782    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:49.967780 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:49.967742    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:50.146135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.146089    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:50.319678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.319640    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"]
Nov 02 13:53:50.330333 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.330295    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.347148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.347121    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-4fc49b-openshift-default-dockercfg-mnqnf\""
Nov 02 13:53:50.356031 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.355977    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"]
Nov 02 13:53:50.358494 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.358458    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:50.424219 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424178    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424219 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424230    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424310    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424371    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424410    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424486    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424530    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkrb\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-kube-api-access-spkrb\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424648 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424583    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.424720 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.424700    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.525456 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525417    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.525456 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525459    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.525734 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525475    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.525734 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525496    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.525734 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525540    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525910    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525959    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.525969    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.526056    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spkrb\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-kube-api-access-spkrb\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.526058    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.526225    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.526236    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.526384    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.526767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.526508    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.528548 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.528519    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.529367 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.529345    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.552891 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.552845    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkrb\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-kube-api-access-spkrb\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.556664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.556550    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.612835 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.612727    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:50.644932 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.644882    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:50.781094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.775658    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:50.924347 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.924266    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:50.947410 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.947371    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"]
Nov 02 13:53:50.950360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.950315    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:50.950528 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.950405    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:50.950528 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:50.950452    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:53:51.249538 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:51.249448    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" event={"ID":"b4fa0fe4-2e64-45ba-95d2-b75d67d28688","Type":"ContainerStarted","Data":"8824eec1b0a259272a6f9c34bd92b4e057c47d99d7fd366eacd367a33a552cd7"}
Nov 02 13:53:51.249538 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:51.249512    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" event={"ID":"b4fa0fe4-2e64-45ba-95d2-b75d67d28688","Type":"ContainerStarted","Data":"897dfa9d805a7b7d102a77ac64e43148b6d1d6a89a726a6c2a504e1da812936a"}
Nov 02 13:53:51.277869 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:51.277800    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podStartSLOduration=1.277778732 podStartE2EDuration="1.277778732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:51.275431838 +0000 UTC m=+610.356576959" watchObservedRunningTime="2026-11-02 13:53:51.277778732 +0000 UTC m=+610.358923853"
Nov 02 13:53:51.645533 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:51.645500    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:51.875157 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:51.875123    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:52.654342 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:52.654304    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:53.264548 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:53.264508    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:53.265721 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:53.265691    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:53:53.613669 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:53.613635    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:53.922132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:53.922040    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:54.139324 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:54.139287    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:54.502445 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:54.502394    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:54.853597 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:54.853564    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:55.107617 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:55.107537    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:55.426752 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:55.426666    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:55.772726 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:55.772643    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:55.964123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:55.964049    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:56.151116 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.151053    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:56.426124 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.425997    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:56.474731 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.474699    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"]
Nov 02 13:53:56.478020 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.478001    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.489819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.489788    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-1eb567\""
Nov 02 13:53:56.491222 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.491199    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"]
Nov 02 13:53:56.494600 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.494582    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.504786 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.504759    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"]
Nov 02 13:53:56.512593 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.512539    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-1eb567-dockercfg-cjjqw\""
Nov 02 13:53:56.514597 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.514567    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"]
Nov 02 13:53:56.588058 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.588017    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.588297 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.588169    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.588297 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.588219    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd6xg\" (UniqueName: \"kubernetes.io/projected/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-kube-api-access-fd6xg\") pod \"payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.588297 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.588257    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kfvs\" (UniqueName: \"kubernetes.io/projected/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-kube-api-access-9kfvs\") pod \"payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.600503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.600458    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:56.689672 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.689574    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd6xg\" (UniqueName: \"kubernetes.io/projected/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-kube-api-access-fd6xg\") pod \"payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.689672 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.689635    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kfvs\" (UniqueName: \"kubernetes.io/projected/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-kube-api-access-9kfvs\") pod \"payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.689914 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.689771    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.689914 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.689890    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.690593 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.690566    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.690997 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.690977    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.708893 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.708854    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kfvs\" (UniqueName: \"kubernetes.io/projected/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-kube-api-access-9kfvs\") pod \"payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.709059 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.709043    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd6xg\" (UniqueName: \"kubernetes.io/projected/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-kube-api-access-fd6xg\") pod \"payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.794004 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.793973    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:53:56.812044 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.812006    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:53:56.990386 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:56.990293    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:57.065183 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.065138    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"]
Nov 02 13:53:57.070023 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.069986    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.084152 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.084119    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-1eb567-serving-cert\""
Nov 02 13:53:57.084514 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.084488    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7dtkz\""
Nov 02 13:53:57.087463 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.087443    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 13:53:57.093820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.093786    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"]
Nov 02 13:53:57.120087 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.120045    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"]
Nov 02 13:53:57.123845 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:53:57.123812    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd52a1bb_8e49_4fd4_b245_e6056ffa66cb.slice/crio-24c32b2c386f02b88c167e239595cdc9dc1e1d61d32cc8f8f627f0e8b0773e12 WatchSource:0}: Error finding container 24c32b2c386f02b88c167e239595cdc9dc1e1d61d32cc8f8f627f0e8b0773e12: Status 404 returned error can't find the container with id 24c32b2c386f02b88c167e239595cdc9dc1e1d61d32cc8f8f627f0e8b0773e12
Nov 02 13:53:57.125882 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.125864    5453 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 13:53:57.148536 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.148507    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"]
Nov 02 13:53:57.149203 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.149153    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 13:53:57.149368 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.149250    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 13:53:57.150921 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:53:57.150890    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918d316e_ed3a_4feb_9cd3_4ca428e7f3d4.slice/crio-62fbf454969078abb76559c212d5c291956e00d2b82b1d17a0fc25c18bc2935e WatchSource:0}: Error finding container 62fbf454969078abb76559c212d5c291956e00d2b82b1d17a0fc25c18bc2935e: Status 404 returned error can't find the container with id 62fbf454969078abb76559c212d5c291956e00d2b82b1d17a0fc25c18bc2935e
Nov 02 13:53:57.194671 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.194637    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.195198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.194682    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-metrics-certs\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.195198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.194757    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6nb\" (UniqueName: \"kubernetes.io/projected/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-kube-api-access-jv6nb\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.195198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.194901    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-maas-api-tls\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.208570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.208525    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:57.294549 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.294500    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" event={"ID":"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4","Type":"ContainerStarted","Data":"62fbf454969078abb76559c212d5c291956e00d2b82b1d17a0fc25c18bc2935e"}
Nov 02 13:53:57.295430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.295406    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-maas-api-tls\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.295605 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.295468    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.295605 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.295491    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-metrics-certs\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.295605 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.295521    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6nb\" (UniqueName: \"kubernetes.io/projected/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-kube-api-access-jv6nb\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.296249 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.296224    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.296732 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.296694    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" event={"ID":"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb","Type":"ContainerStarted","Data":"24c32b2c386f02b88c167e239595cdc9dc1e1d61d32cc8f8f627f0e8b0773e12"}
Nov 02 13:53:57.298288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.298265    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-maas-api-tls\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.298613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.298594    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-metrics-certs\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.311868 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.311831    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6nb\" (UniqueName: \"kubernetes.io/projected/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-kube-api-access-jv6nb\") pod \"maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.388640 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.385878    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:57.390198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.390169    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:57.694439 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:57.694404    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"]
Nov 02 13:53:57.707848 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:53:57.707810    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea8950d_16b5_44f0_9eb5_ce3ce4500537.slice/crio-ffed5f6946ef863f182ca0ddc44167d9c67eb15ffb57378b42d881a979704e0b WatchSource:0}: Error finding container ffed5f6946ef863f182ca0ddc44167d9c67eb15ffb57378b42d881a979704e0b: Status 404 returned error can't find the container with id ffed5f6946ef863f182ca0ddc44167d9c67eb15ffb57378b42d881a979704e0b
Nov 02 13:53:58.209325 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.209262    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:58.315723 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.313628    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"]
Nov 02 13:53:58.326856 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.325496    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"]
Nov 02 13:53:58.326856 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.325552    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f" event={"ID":"4ea8950d-16b5-44f0-9eb5-ce3ce4500537","Type":"ContainerStarted","Data":"ffed5f6946ef863f182ca0ddc44167d9c67eb15ffb57378b42d881a979704e0b"}
Nov 02 13:53:58.326856 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.325680    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.331891 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.331241    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-1d18fb\""
Nov 02 13:53:58.351002 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.350903    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-1d18fb-dockercfg-k4c4p\""
Nov 02 13:53:58.407221 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.407190    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:58.417503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.417460    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2xdm\" (UniqueName: \"kubernetes.io/projected/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-kube-api-access-g2xdm\") pod \"payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.417682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.417521    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.520409 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.518799    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2xdm\" (UniqueName: \"kubernetes.io/projected/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-kube-api-access-g2xdm\") pod \"payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.520409 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.518869    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.520409 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.519881    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.536165 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.533654    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2xdm\" (UniqueName: \"kubernetes.io/projected/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-kube-api-access-g2xdm\") pod \"payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.578578 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.578538    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:58.650518 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.650471    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:53:58.964729 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.964007    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"]
Nov 02 13:53:58.973214 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:53:58.973173    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc549e9a1_2e91_4d6c_98f0_f1696fdcd2e4.slice/crio-6054b0562c06b51674da727d0d292b874c3f3262486842181c5ecab1d94c93ae WatchSource:0}: Error finding container 6054b0562c06b51674da727d0d292b874c3f3262486842181c5ecab1d94c93ae: Status 404 returned error can't find the container with id 6054b0562c06b51674da727d0d292b874c3f3262486842181c5ecab1d94c93ae
Nov 02 13:53:58.986981 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:58.986951    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:59.216129 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:59.215966    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:59.332811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:59.332768    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f" event={"ID":"4ea8950d-16b5-44f0-9eb5-ce3ce4500537","Type":"ContainerStarted","Data":"30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927"}
Nov 02 13:53:59.333819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:59.333797    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:53:59.335819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:59.335750    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" event={"ID":"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4","Type":"ContainerStarted","Data":"6054b0562c06b51674da727d0d292b874c3f3262486842181c5ecab1d94c93ae"}
Nov 02 13:53:59.379959 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:59.378926    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f" podStartSLOduration=1.876734011 podStartE2EDuration="2.378905544s" totalImagesPullingTime="502.171533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:59.378252509 +0000 UTC m=+618.459397629" watchObservedRunningTime="2026-11-02 13:53:59.378905544 +0000 UTC m=+618.460050665"
Nov 02 13:53:59.504688 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:59.504605    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:53:59.747352 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:53:59.747223    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:00.008523 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.008486    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:00.286025 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.285983    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:00.313957 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.313917    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"]
Nov 02 13:54:00.324380 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.324084    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:00.331252 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.331178    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"]
Nov 02 13:54:00.423312 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.423261    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-f2e945\""
Nov 02 13:54:00.424774 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.424729    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:00.465836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.463536    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2935f3c-7d58-4bc1-a530-574129413527-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:00.465836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.463657    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhcf4\" (UniqueName: \"kubernetes.io/projected/c2935f3c-7d58-4bc1-a530-574129413527-kube-api-access-xhcf4\") pod \"payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:00.565821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.564830    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2935f3c-7d58-4bc1-a530-574129413527-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:00.565821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.564932    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhcf4\" (UniqueName: \"kubernetes.io/projected/c2935f3c-7d58-4bc1-a530-574129413527-kube-api-access-xhcf4\") pod \"payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:00.565821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.565718    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2935f3c-7d58-4bc1-a530-574129413527-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:00.579856 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.579534    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhcf4\" (UniqueName: \"kubernetes.io/projected/c2935f3c-7d58-4bc1-a530-574129413527-kube-api-access-xhcf4\") pod \"payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:00.670635 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:00.670356    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:01.003782 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.003670    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"]
Nov 02 13:54:01.007503 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:01.007470    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2935f3c_7d58_4bc1_a530_574129413527.slice/crio-3794097ddf32c7068bf77c6ebe666e61288fd981ccf1648d4c9fac5f2d9afc30 WatchSource:0}: Error finding container 3794097ddf32c7068bf77c6ebe666e61288fd981ccf1648d4c9fac5f2d9afc30: Status 404 returned error can't find the container with id 3794097ddf32c7068bf77c6ebe666e61288fd981ccf1648d4c9fac5f2d9afc30
Nov 02 13:54:01.032711 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.032673    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:01.194061 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.194025    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:01.377396 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.377355    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" event={"ID":"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4","Type":"ContainerStarted","Data":"0a751babef84b7a3e6422550549fa689adeec1eb699a6f6b1b7e8b3289079398"}
Nov 02 13:54:01.377919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.377489    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:54:01.379373 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.379342    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" event={"ID":"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb","Type":"ContainerStarted","Data":"a7f5cdd8fc43c62a049241828b98291445e300546c84e8f17414f5db415c3cc2"}
Nov 02 13:54:01.379527 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.379493    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:54:01.381298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.381272    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" event={"ID":"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4","Type":"ContainerStarted","Data":"8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8"}
Nov 02 13:54:01.381488 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.381393    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:54:01.383016 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.382991    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" event={"ID":"c2935f3c-7d58-4bc1-a530-574129413527","Type":"ContainerStarted","Data":"3794097ddf32c7068bf77c6ebe666e61288fd981ccf1648d4c9fac5f2d9afc30"}
Nov 02 13:54:01.397821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.397756    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" podStartSLOduration=1.3448719740000001 podStartE2EDuration="5.397740733s" totalImagesPullingTime="4.052868759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:01.396774618 +0000 UTC m=+620.477919740" watchObservedRunningTime="2026-11-02 13:54:01.397740733 +0000 UTC m=+620.478885853"
Nov 02 13:54:01.420205 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.420138    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" podStartSLOduration=1.320638692 podStartE2EDuration="5.420120413s" totalImagesPullingTime="4.099481721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:01.417201511 +0000 UTC m=+620.498346632" watchObservedRunningTime="2026-11-02 13:54:01.420120413 +0000 UTC m=+620.501265534"
Nov 02 13:54:01.816953 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.816883    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" podStartSLOduration=1.566846232 podStartE2EDuration="3.816861909s" totalImagesPullingTime="2.250015677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:01.440394285 +0000 UTC m=+620.521539406" watchObservedRunningTime="2026-11-02 13:54:01.816861909 +0000 UTC m=+620.898007056"
Nov 02 13:54:01.817465 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.817442    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"]
Nov 02 13:54:01.822405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.822296    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.836682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.831210    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-ee7df2-serving-cert\""
Nov 02 13:54:01.836682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.835162    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"]
Nov 02 13:54:01.879694 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.879658    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0a891d-d103-47a4-ab73-6860eefdcd0f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.879898 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.879773    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.879898 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.879859    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-metrics-certs\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.879898 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.879883    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bg7x\" (UniqueName: \"kubernetes.io/projected/0c0a891d-d103-47a4-ab73-6860eefdcd0f-kube-api-access-9bg7x\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.903566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.903522    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:01.981290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.981249    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0a891d-d103-47a4-ab73-6860eefdcd0f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.981491 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.981300    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.981491 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.981332    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-metrics-certs\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.981491 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.981349    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bg7x\" (UniqueName: \"kubernetes.io/projected/0c0a891d-d103-47a4-ab73-6860eefdcd0f-kube-api-access-9bg7x\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.982643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.982607    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0a891d-d103-47a4-ab73-6860eefdcd0f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.984213 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.984184    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.984317 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.984300    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-metrics-certs\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:01.996886 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:01.996850    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bg7x\" (UniqueName: \"kubernetes.io/projected/0c0a891d-d103-47a4-ab73-6860eefdcd0f-kube-api-access-9bg7x\") pod \"maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:02.052209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.052167    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:02.144585 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.144489    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:02.392615 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.392578    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" event={"ID":"c2935f3c-7d58-4bc1-a530-574129413527","Type":"ContainerStarted","Data":"86f3fb81054763333155d2f88e02e995f2d19c07038734745d32a91b441e88d1"}
Nov 02 13:54:02.393185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.392678    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:02.418926 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.418805    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" podStartSLOduration=2.026837486 podStartE2EDuration="2.418788604s" totalImagesPullingTime="391.951118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:02.415778482 +0000 UTC m=+621.496923601" watchObservedRunningTime="2026-11-02 13:54:02.418788604 +0000 UTC m=+621.499933723"
Nov 02 13:54:02.438801 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.438775    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"]
Nov 02 13:54:02.441098 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:02.441048    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0a891d_d103_47a4_ab73_6860eefdcd0f.slice/crio-7be06026fd2727158549e93d539bcf577ea3ccfefa029704acdbd42721f302ff WatchSource:0}: Error finding container 7be06026fd2727158549e93d539bcf577ea3ccfefa029704acdbd42721f302ff: Status 404 returned error can't find the container with id 7be06026fd2727158549e93d539bcf577ea3ccfefa029704acdbd42721f302ff
Nov 02 13:54:02.833334 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.833290    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:02.980614 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:02.980583    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:03.400522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:03.400487    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2" event={"ID":"0c0a891d-d103-47a4-ab73-6860eefdcd0f","Type":"ContainerStarted","Data":"9263103dda52a9f25f46e336e7cc7c79c7908f163185042330b273f113a71324"}
Nov 02 13:54:03.400970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:03.400551    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2" event={"ID":"0c0a891d-d103-47a4-ab73-6860eefdcd0f","Type":"ContainerStarted","Data":"7be06026fd2727158549e93d539bcf577ea3ccfefa029704acdbd42721f302ff"}
Nov 02 13:54:03.400970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:03.400584    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:03.426214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:03.426137    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2" podStartSLOduration=1.910254368 podStartE2EDuration="2.426116832s" totalImagesPullingTime="515.862464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:03.423517895 +0000 UTC m=+622.504663051" watchObservedRunningTime="2026-11-02 13:54:03.426116832 +0000 UTC m=+622.507261952"
Nov 02 13:54:03.730292 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:03.730206    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:04.676587 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:04.676539    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:05.988681 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:05.988646    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"]
Nov 02 13:54:05.993436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:05.993398    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"]
Nov 02 13:54:05.993613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:05.993549    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.009145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.009117    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-f2e945-serving-cert\""
Nov 02 13:54:06.069033 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.068986    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:06.116636 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:54:06.116599    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:54:06.130272 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.130235    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pxvl\" (UniqueName: \"kubernetes.io/projected/17c50d12-5f0d-422a-8469-1e72ef7301e8-kube-api-access-6pxvl\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.130465 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.130413    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-metrics-certs\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.130686 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.130665    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c50d12-5f0d-422a-8469-1e72ef7301e8-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.130892 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.130856    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.222791 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.222751    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:06.240242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.233575    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pxvl\" (UniqueName: \"kubernetes.io/projected/17c50d12-5f0d-422a-8469-1e72ef7301e8-kube-api-access-6pxvl\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.240242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.233688    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-metrics-certs\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.240242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.233748    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c50d12-5f0d-422a-8469-1e72ef7301e8-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.240242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.233811    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.240242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.235478    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c50d12-5f0d-422a-8469-1e72ef7301e8-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.277103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.251607    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.277103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.259177    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-metrics-certs\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.277103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.260671    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pxvl\" (UniqueName: \"kubernetes.io/projected/17c50d12-5f0d-422a-8469-1e72ef7301e8-kube-api-access-6pxvl\") pod \"maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.323092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.320269    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:06.385094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.382596    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:06.397112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.394347    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 13:54:06.735146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:06.735110    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"]
Nov 02 13:54:07.058098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:07.051683    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:07.432030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:07.431930    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct" event={"ID":"17c50d12-5f0d-422a-8469-1e72ef7301e8","Type":"ContainerStarted","Data":"7bd36ea304d20ed73a5dfc2c76213e9c00c216a90eff8d13f6b03f2a01c91231"}
Nov 02 13:54:07.432030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:07.431991    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct" event={"ID":"17c50d12-5f0d-422a-8469-1e72ef7301e8","Type":"ContainerStarted","Data":"e8f7a517264b4d41d12bee17d11abed76b6d591a6525d9d80ab09131767a17de"}
Nov 02 13:54:07.432292 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:07.432036    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:07.463672 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:07.463607    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct" podStartSLOduration=2.020047694 podStartE2EDuration="2.463588703s" totalImagesPullingTime="443.541009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:07.453656192 +0000 UTC m=+626.534801320" watchObservedRunningTime="2026-11-02 13:54:07.463588703 +0000 UTC m=+626.544733824"
Nov 02 13:54:07.968096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:07.967380    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:08.471061 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:08.471030    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:08.688306 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:08.688268    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:09.064649 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:09.064616    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:09.234200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:09.234172    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:09.403086 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:09.402990    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:09.413664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:09.413632    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 13:54:09.590531 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:09.590490    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:10.491542 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:10.491445    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:11.321927 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.321885    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"]
Nov 02 13:54:11.326920 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.326884    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.345186 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.345152    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9e0c2f\"/\"simulator-w4-9e0c2f-kserve-self-signed-certs\""
Nov 02 13:54:11.345492 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.345476    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-9e0c2f\"/\"kube-root-ca.crt\""
Nov 02 13:54:11.345719 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.345705    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9e0c2f\"/\"default-dockercfg-kmfmt\""
Nov 02 13:54:11.345898 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.345885    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-9e0c2f\"/\"openshift-service-ca.crt\""
Nov 02 13:54:11.346345 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.346324    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"]
Nov 02 13:54:11.418503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.417665    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-dshm\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.418503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.417710    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-model-cache\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.418503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.417739    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/2f2e3ba0-8157-491c-985f-272f60c674a8-kube-api-access-4pdgl\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.418503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.417767    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-home\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.418503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.417804    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2e3ba0-8157-491c-985f-272f60c674a8-tls-certs\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.418503 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.417857    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-tmp-dir\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.460029 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.459895    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:11.519092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.518683    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-dshm\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.519092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.518739    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-model-cache\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.519092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.518774    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/2f2e3ba0-8157-491c-985f-272f60c674a8-kube-api-access-4pdgl\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.519092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.518806    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-home\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.519092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.518847    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2e3ba0-8157-491c-985f-272f60c674a8-tls-certs\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.519092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.518895    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-tmp-dir\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.519551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.519525    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-tmp-dir\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.520376 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.520341    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-home\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.520498 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.520428    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-model-cache\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.523483 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.523433    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-dshm\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.523483 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.523471    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2e3ba0-8157-491c-985f-272f60c674a8-tls-certs\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.534090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.533932    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/2f2e3ba0-8157-491c-985f-272f60c674a8-kube-api-access-4pdgl\") pod \"simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") " pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.660998 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.660308    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:11.977059 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.976921    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"]
Nov 02 13:54:11.990282 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:11.990219    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f2e3ba0_8157_491c_985f_272f60c674a8.slice/crio-dd5615678d94e88233b0ef55ad23f2626d2773d7829d7dfa154ece8695acad54 WatchSource:0}: Error finding container dd5615678d94e88233b0ef55ad23f2626d2773d7829d7dfa154ece8695acad54: Status 404 returned error can't find the container with id dd5615678d94e88233b0ef55ad23f2626d2773d7829d7dfa154ece8695acad54
Nov 02 13:54:11.993863 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:11.993822    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:12.403754 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:12.403720    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:54:12.404405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:12.404382    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:54:12.404960 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:12.404938    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 13:54:12.527852 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:12.527812    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" event={"ID":"2f2e3ba0-8157-491c-985f-272f60c674a8","Type":"ContainerStarted","Data":"dd5615678d94e88233b0ef55ad23f2626d2773d7829d7dfa154ece8695acad54"}
Nov 02 13:54:13.164113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:13.164036    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:13.404970 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:13.404936    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 13:54:13.458862 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:13.457792    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 13:54:14.016407 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:14.016326    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:14.160058 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:14.160006    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:14.316533 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:14.316469    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:14.551624 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:14.551578    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" event={"ID":"2f2e3ba0-8157-491c-985f-272f60c674a8","Type":"ContainerStarted","Data":"afe9fa0e88916867bec9f67b5c950d6c2d4f4c9f01537e4de6b08c945eed73fa"}
Nov 02 13:54:14.624432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:14.624310    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podStartSLOduration=1.855843226 podStartE2EDuration="3.624291643s" totalImagesPullingTime="1.768448417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:14.623043719 +0000 UTC m=+633.704188838" watchObservedRunningTime="2026-11-02 13:54:14.624291643 +0000 UTC m=+633.705436764"
Nov 02 13:54:14.661816 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:14.661770    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:14.741523 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:14.741484    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:15.048631 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.047675    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:15.324265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.324226    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:15.564537 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.564501    5453 generic.go:356] "Generic (PLEG): container finished" podID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerID="8824eec1b0a259272a6f9c34bd92b4e057c47d99d7fd366eacd367a33a552cd7" exitCode=0
Nov 02 13:54:15.564945 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.564587    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" event={"ID":"b4fa0fe4-2e64-45ba-95d2-b75d67d28688","Type":"ContainerDied","Data":"8824eec1b0a259272a6f9c34bd92b4e057c47d99d7fd366eacd367a33a552cd7"}
Nov 02 13:54:15.565123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.565106    5453 scope.go:122] "RemoveContainer" containerID="8824eec1b0a259272a6f9c34bd92b4e057c47d99d7fd366eacd367a33a552cd7"
Nov 02 13:54:15.566528 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.566492    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:54:15.566648 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.566564    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:54:15.566648 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:15.566597    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:54:16.577051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:16.577015    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" event={"ID":"b4fa0fe4-2e64-45ba-95d2-b75d67d28688","Type":"ContainerStarted","Data":"a4301f389efbdc68e9d1a624ebbeb22b17faa3bd12fe360b9d72f1454b4f9587"}
Nov 02 13:54:16.649179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:16.648525    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:54:16.649179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:16.648670    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Nov 02 13:54:16.649179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:16.648717    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Nov 02 13:54:16.668566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:16.668526    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:17.645600 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:17.645560    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Nov 02 13:54:17.646552 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:17.646517    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Nov 02 13:54:17.810717 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:17.810600    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:18.220219 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:18.220170    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:18.645576 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:18.645532    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Nov 02 13:54:18.645931 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:18.645899    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Nov 02 13:54:18.754869 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:18.754832    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:18.890794 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:18.890758    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:19.369098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:19.369027    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:19.508383 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:19.508352    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:19.645642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:19.645510    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Nov 02 13:54:19.646036 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:19.646003    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Nov 02 13:54:19.652590 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:19.652555    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:19.823351 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:19.823309    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:20.320174 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:20.320127    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:20.478143 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:20.478107    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:20.657772 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:20.657331    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Nov 02 13:54:20.657772 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:20.657402    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Nov 02 13:54:20.719657 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:20.719599    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:21.075499 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:21.075455    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:21.648095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:21.647789    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Nov 02 13:54:21.648095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:21.647914    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Nov 02 13:54:21.662592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:21.662559    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:21.763507 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:21.763475    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:22.124129 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:22.124047    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:22.294575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:22.294543    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:22.687274 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:22.686983    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:54:22.847870 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:22.847839    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:54:22.848625 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:22.848604    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:54:22.851712 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:22.851689    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 13:54:23.415094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.415040    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:23.530753 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.527319    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"]
Nov 02 13:54:23.542094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.542030    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"]
Nov 02 13:54:23.542298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.542180    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.553759 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.553727    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-ee7df2\"/\"openshift-service-ca.crt\""
Nov 02 13:54:23.554952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.554931    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-ee7df2\"/\"kube-root-ca.crt\""
Nov 02 13:54:23.564705 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.564673    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-ee7df2\"/\"default-dockercfg-pjdxg\""
Nov 02 13:54:23.564705 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.564672    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-ee7df2\"/\"simulator-w2-ee7df2-kserve-self-signed-certs\""
Nov 02 13:54:23.620436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.620403    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:23.623729 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.623692    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74a849-251d-4635-afac-0662f5c22b65-tls-certs\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.623867 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.623740    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfz28\" (UniqueName: \"kubernetes.io/projected/8a74a849-251d-4635-afac-0662f5c22b65-kube-api-access-xfz28\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.623867 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.623790    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-dshm\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.623942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.623869    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-model-cache\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.623942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.623895    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-home\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.623942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.623923    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-tmp-dir\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.725338 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.725232    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfz28\" (UniqueName: \"kubernetes.io/projected/8a74a849-251d-4635-afac-0662f5c22b65-kube-api-access-xfz28\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.725338 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.725282    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-dshm\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.725338 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.725322    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-model-cache\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.726016 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.725357    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-home\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.726016 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.725402    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-tmp-dir\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.726016 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.725655    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74a849-251d-4635-afac-0662f5c22b65-tls-certs\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.731101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.726518    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-home\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.731101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.726805    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-model-cache\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.731101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.727102    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-tmp-dir\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.734143 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.734061    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-dshm\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.735500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.735465    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74a849-251d-4635-afac-0662f5c22b65-tls-certs\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.742446 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.742408    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfz28\" (UniqueName: \"kubernetes.io/projected/8a74a849-251d-4635-afac-0662f5c22b65-kube-api-access-xfz28\") pod \"simulator-w2-ee7df2-kserve-7c589c5dfd-7h669\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") " pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:23.861542 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:23.861498    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:24.150945 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:24.150909    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"]
Nov 02 13:54:24.155363 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:24.155328    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a74a849_251d_4635_afac_0662f5c22b65.slice/crio-53f5a8b66dcde9c20108fda95776781ed2adf41b02e4be8558ef60fe317664eb WatchSource:0}: Error finding container 53f5a8b66dcde9c20108fda95776781ed2adf41b02e4be8558ef60fe317664eb: Status 404 returned error can't find the container with id 53f5a8b66dcde9c20108fda95776781ed2adf41b02e4be8558ef60fe317664eb
Nov 02 13:54:24.303354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:24.303312    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:24.672143 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:24.672102    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" event={"ID":"8a74a849-251d-4635-afac-0662f5c22b65","Type":"ContainerStarted","Data":"c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458"}
Nov 02 13:54:24.672143 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:24.672149    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" event={"ID":"8a74a849-251d-4635-afac-0662f5c22b65","Type":"ContainerStarted","Data":"53f5a8b66dcde9c20108fda95776781ed2adf41b02e4be8558ef60fe317664eb"}
Nov 02 13:54:24.731821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:24.731769    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podStartSLOduration=1.7317533379999999 podStartE2EDuration="1.731753338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:24.730135139 +0000 UTC m=+643.811280271" watchObservedRunningTime="2026-11-02 13:54:24.731753338 +0000 UTC m=+643.812898457"
Nov 02 13:54:24.861644 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:24.861607    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:25.358923 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:25.358882    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:26.240460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:26.240429    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:26.544094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:26.541202    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:27.180442 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:27.180407    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:28.493835 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:28.493789    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:29.413103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:29.413055    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:30.182930 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.182893    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:30.301414 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.301375    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"]
Nov 02 13:54:30.305417 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.305394    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.314121 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.314091    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-1eb567\"/\"simulator-w6-1eb567-kserve-self-signed-certs\""
Nov 02 13:54:30.319196 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.319159    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"]
Nov 02 13:54:30.320096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.320043    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-1eb567\"/\"kube-root-ca.crt\""
Nov 02 13:54:30.320242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.320159    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-1eb567\"/\"openshift-service-ca.crt\""
Nov 02 13:54:30.352821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.352788    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-1eb567\"/\"default-dockercfg-2r796\""
Nov 02 13:54:30.383623 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.383581    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:30.402124 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.402084    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-model-cache\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.402311 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.402210    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-home\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.402311 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.402256    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnqz\" (UniqueName: \"kubernetes.io/projected/a7dc59d6-faef-4978-aee8-0558ef191f47-kube-api-access-7vnqz\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.402311 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.402283    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-dshm\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.402432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.402377    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-tmp-dir\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.402432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.402409    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7dc59d6-faef-4978-aee8-0558ef191f47-tls-certs\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.503938 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.503823    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-home\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.504288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.504249    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnqz\" (UniqueName: \"kubernetes.io/projected/a7dc59d6-faef-4978-aee8-0558ef191f47-kube-api-access-7vnqz\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.504430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.504300    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-dshm\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.504430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.504332    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-home\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.504430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.504367    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-tmp-dir\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.504430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.504411    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7dc59d6-faef-4978-aee8-0558ef191f47-tls-certs\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.504652 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.504508    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-model-cache\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.504899 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.504874    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-model-cache\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.505244 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.505223    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-tmp-dir\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.507300 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.507279    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-dshm\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.507664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.507641    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7dc59d6-faef-4978-aee8-0558ef191f47-tls-certs\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.519820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.519790    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnqz\" (UniqueName: \"kubernetes.io/projected/a7dc59d6-faef-4978-aee8-0558ef191f47-kube-api-access-7vnqz\") pod \"simulator-w6-1eb567-kserve-68fdcd965-rfw4c\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") " pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.624150 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.624112    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:30.915521 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:30.915491    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"]
Nov 02 13:54:30.917172 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:30.917142    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7dc59d6_faef_4978_aee8_0558ef191f47.slice/crio-722773de87d414724926596c5625b706ef19e0bbef89048ad0c36176c3cea7c2 WatchSource:0}: Error finding container 722773de87d414724926596c5625b706ef19e0bbef89048ad0c36176c3cea7c2: Status 404 returned error can't find the container with id 722773de87d414724926596c5625b706ef19e0bbef89048ad0c36176c3cea7c2
Nov 02 13:54:31.160348 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:31.160313    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:31.722148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:31.722113    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" event={"ID":"a7dc59d6-faef-4978-aee8-0558ef191f47","Type":"ContainerStarted","Data":"5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6"}
Nov 02 13:54:31.722649 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:31.722160    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" event={"ID":"a7dc59d6-faef-4978-aee8-0558ef191f47","Type":"ContainerStarted","Data":"722773de87d414724926596c5625b706ef19e0bbef89048ad0c36176c3cea7c2"}
Nov 02 13:54:31.768847 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:31.767968    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podStartSLOduration=1.767947018 podStartE2EDuration="1.767947018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:31.76321732 +0000 UTC m=+650.844362444" watchObservedRunningTime="2026-11-02 13:54:31.767947018 +0000 UTC m=+650.849092138"
Nov 02 13:54:32.247883 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:32.247842    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:32.624893 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:32.624848    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:33.123210 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:33.123156    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:33.308504 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:33.308470    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:33.862011 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:33.861967    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:33.876532 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:33.876500    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:34.011513 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:34.011480    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:34.759682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:34.759649    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:54:34.834477 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:34.834425    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:35.842488 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:35.842449    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:35.979500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:35.979460    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:36.084476 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:54:36.084440    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:54:36.817848 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:36.817813    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:37.671498 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:37.671450    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:38.419764 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:38.419727    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:39.622900 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:39.622869    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:40.607542 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:40.607498    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:40.626270 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:40.626165    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:40.642886 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:40.642849    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:40.800853 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:40.800823    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:54:41.437953 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:41.437904    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:42.261389 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.261357    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:42.319748 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.319709    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"]
Nov 02 13:54:42.325638 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.325603    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.335431 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.335376    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9e0c2f\"/\"premium-w4-9e0c2f-kserve-self-signed-certs\""
Nov 02 13:54:42.340115 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.340082    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"]
Nov 02 13:54:42.436975 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.436935    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:42.442642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.442599    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-tmp-dir\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.442918 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.442899    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-home\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.443056 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.443042    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls22n\" (UniqueName: \"kubernetes.io/projected/e2ffe821-d125-4899-926e-395d1fe2fa95-kube-api-access-ls22n\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.443315 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.443299    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ffe821-d125-4899-926e-395d1fe2fa95-tls-certs\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.443419 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.443406    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-dshm\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.443512 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.443500    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-model-cache\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.544290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.544257    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-home\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.544492 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.544311    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls22n\" (UniqueName: \"kubernetes.io/projected/e2ffe821-d125-4899-926e-395d1fe2fa95-kube-api-access-ls22n\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.544492 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.544381    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ffe821-d125-4899-926e-395d1fe2fa95-tls-certs\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.544492 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.544398    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-dshm\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.544492 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.544414    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-model-cache\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.544492 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.544436    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-tmp-dir\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.544791 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.544769    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-tmp-dir\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.545237 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.545209    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-model-cache\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.545489 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.545468    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-home\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.552798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.552207    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-dshm\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.553932 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.553897    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ffe821-d125-4899-926e-395d1fe2fa95-tls-certs\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.559615 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.559582    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls22n\" (UniqueName: \"kubernetes.io/projected/e2ffe821-d125-4899-926e-395d1fe2fa95-kube-api-access-ls22n\") pod \"premium-w4-9e0c2f-kserve-7b8649c75f-x9knb\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") " pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.640615 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.640571    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:42.956936 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:42.956901    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"]
Nov 02 13:54:42.960306 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:42.960274    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2ffe821_d125_4899_926e_395d1fe2fa95.slice/crio-7533674d3fad45bd4553fb596ade68382c66594b63193426b6e6a6ebe70d64ef WatchSource:0}: Error finding container 7533674d3fad45bd4553fb596ade68382c66594b63193426b6e6a6ebe70d64ef: Status 404 returned error can't find the container with id 7533674d3fad45bd4553fb596ade68382c66594b63193426b6e6a6ebe70d64ef
Nov 02 13:54:43.195443 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:43.195414    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:43.803849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:43.803813    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" event={"ID":"e2ffe821-d125-4899-926e-395d1fe2fa95","Type":"ContainerStarted","Data":"4710a5f40254a7a8bcfd60a8d7d4890df58e49d3839ab69cea3f3f07408579e3"}
Nov 02 13:54:43.803849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:43.803852    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" event={"ID":"e2ffe821-d125-4899-926e-395d1fe2fa95","Type":"ContainerStarted","Data":"7533674d3fad45bd4553fb596ade68382c66594b63193426b6e6a6ebe70d64ef"}
Nov 02 13:54:43.865547 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:43.865483    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podStartSLOduration=1.865466268 podStartE2EDuration="1.865466268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:43.863570202 +0000 UTC m=+662.944715323" watchObservedRunningTime="2026-11-02 13:54:43.865466268 +0000 UTC m=+662.946611388"
Nov 02 13:54:44.195508 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:44.195417    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:44.640828 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:44.640789    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:45.025204 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:45.025103    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:45.840857 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:45.840822    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:46.696688 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:46.696655    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:47.548725 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.548672    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:47.561456 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.561406    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"]
Nov 02 13:54:47.565381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.565355    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.576699 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.576493    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-1d18fb\"/\"openshift-service-ca.crt\""
Nov 02 13:54:47.576699 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.576630    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-1d18fb\"/\"premium-w5-1d18fb-kserve-self-signed-certs\""
Nov 02 13:54:47.576699 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.576696    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-1d18fb\"/\"default-dockercfg-64xsj\""
Nov 02 13:54:47.580857 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.580635    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"]
Nov 02 13:54:47.581246 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.581221    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-1d18fb\"/\"kube-root-ca.crt\""
Nov 02 13:54:47.698647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.698609    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:47.702267 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.702233    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-model-cache\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.702267 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.702271    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-tmp-dir\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.702535 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.702299    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-home\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.702535 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.702348    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1608f6-6d4b-4273-b463-759b115c1989-tls-certs\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.702535 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.702372    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbcfx\" (UniqueName: \"kubernetes.io/projected/ac1608f6-6d4b-4273-b463-759b115c1989-kube-api-access-zbcfx\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.702535 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.702389    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-dshm\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803379 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803283    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-model-cache\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803379 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803323    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-tmp-dir\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803442    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-home\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803528    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1608f6-6d4b-4273-b463-759b115c1989-tls-certs\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803572    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbcfx\" (UniqueName: \"kubernetes.io/projected/ac1608f6-6d4b-4273-b463-759b115c1989-kube-api-access-zbcfx\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803601    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-dshm\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803833 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803654    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-model-cache\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.803833 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.803776    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-tmp-dir\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.804307 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.804281    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-home\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.806485 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.806456    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1608f6-6d4b-4273-b463-759b115c1989-tls-certs\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.807335 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.807311    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-dshm\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.816935 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.816807    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbcfx\" (UniqueName: \"kubernetes.io/projected/ac1608f6-6d4b-4273-b463-759b115c1989-kube-api-access-zbcfx\") pod \"premium-w5-1d18fb-kserve-75f6b69777-qtzk8\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") " pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:47.885380 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:47.885331    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:48.178968 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:48.178940    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"]
Nov 02 13:54:48.181322 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:48.181286    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac1608f6_6d4b_4273_b463_759b115c1989.slice/crio-d145f864adcd44e874357a007719498d8f227e5b180da2b2709657e96104e3c6 WatchSource:0}: Error finding container d145f864adcd44e874357a007719498d8f227e5b180da2b2709657e96104e3c6: Status 404 returned error can't find the container with id d145f864adcd44e874357a007719498d8f227e5b180da2b2709657e96104e3c6
Nov 02 13:54:48.333883 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:48.333844    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:48.836778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:48.836740    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" event={"ID":"ac1608f6-6d4b-4273-b463-759b115c1989","Type":"ContainerStarted","Data":"8486d20820489c4cc35826d5773f9042734f9e8092fca6253bd11899cebbb0c0"}
Nov 02 13:54:48.837309 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:48.836793    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" event={"ID":"ac1608f6-6d4b-4273-b463-759b115c1989","Type":"ContainerStarted","Data":"d145f864adcd44e874357a007719498d8f227e5b180da2b2709657e96104e3c6"}
Nov 02 13:54:48.862173 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:48.862109    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podStartSLOduration=1.862053332 podStartE2EDuration="1.862053332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:48.860239121 +0000 UTC m=+667.941384243" watchObservedRunningTime="2026-11-02 13:54:48.862053332 +0000 UTC m=+667.943198453"
Nov 02 13:54:48.885756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:48.885713    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:49.266091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:49.265982    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:50.002775 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:50.002735    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:50.951441 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:50.951407    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:51.698674 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.698277    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"]
Nov 02 13:54:51.709112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.709084    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.717660 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.717626    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-4fc49b\"/\"default-dockercfg-9pj54\""
Nov 02 13:54:51.718711 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.718675    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-4fc49b\"/\"premium-w3-4fc49b-kserve-self-signed-certs\""
Nov 02 13:54:51.719348 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.719285    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-4fc49b\"/\"kube-root-ca.crt\""
Nov 02 13:54:51.719482 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.719426    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-4fc49b\"/\"openshift-service-ca.crt\""
Nov 02 13:54:51.723607 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.723572    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"]
Nov 02 13:54:51.843170 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.843116    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-model-cache\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.843374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.843243    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-home\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.843473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.843365    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tmp-dir\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.843473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.843412    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-dshm\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.843473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.843454    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tls-certs\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.843633 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.843556    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnx4\" (UniqueName: \"kubernetes.io/projected/aeec8ee0-b48c-46ba-b5a6-e156f554e492-kube-api-access-lfnx4\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.865336 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.862922    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:51.944774 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.944720    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-dshm\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.944961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.944783    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tls-certs\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.944961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.944828    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnx4\" (UniqueName: \"kubernetes.io/projected/aeec8ee0-b48c-46ba-b5a6-e156f554e492-kube-api-access-lfnx4\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.944961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.944941    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-model-cache\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.945208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.944994    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-home\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.945208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.945056    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tmp-dir\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.945506 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.945482    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tmp-dir\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.945609 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.945582    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-model-cache\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.945748 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.945728    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-home\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.949544 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.949375    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tls-certs\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.949544 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.949447    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-dshm\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:51.965498 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:51.965462    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnx4\" (UniqueName: \"kubernetes.io/projected/aeec8ee0-b48c-46ba-b5a6-e156f554e492-kube-api-access-lfnx4\") pod \"premium-w3-4fc49b-kserve-98b54657c-6q2cc\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") " pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:52.025295 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.025256    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:52.138237 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.137052    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:52.338682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.338648    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"]
Nov 02 13:54:52.341707 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:52.341671    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeec8ee0_b48c_46ba_b5a6_e156f554e492.slice/crio-9e32fefcfe155cd34e4c5fb88461c3c8f801532f456e7b80928d7a50e8d1c41f WatchSource:0}: Error finding container 9e32fefcfe155cd34e4c5fb88461c3c8f801532f456e7b80928d7a50e8d1c41f: Status 404 returned error can't find the container with id 9e32fefcfe155cd34e4c5fb88461c3c8f801532f456e7b80928d7a50e8d1c41f
Nov 02 13:54:52.641631 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.641514    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:52.680030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.677534    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:52.903604 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.903495    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" event={"ID":"aeec8ee0-b48c-46ba-b5a6-e156f554e492","Type":"ContainerStarted","Data":"48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69"}
Nov 02 13:54:52.903604 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.903561    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" event={"ID":"aeec8ee0-b48c-46ba-b5a6-e156f554e492","Type":"ContainerStarted","Data":"9e32fefcfe155cd34e4c5fb88461c3c8f801532f456e7b80928d7a50e8d1c41f"}
Nov 02 13:54:52.916930 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.916900    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:54:52.930461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:52.930406    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podStartSLOduration=1.93038983 podStartE2EDuration="1.93038983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:52.92832677 +0000 UTC m=+672.009471891" watchObservedRunningTime="2026-11-02 13:54:52.93038983 +0000 UTC m=+672.011534941"
Nov 02 13:54:53.025659 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.025619    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:54:53.108480 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.108446    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:53.696352 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.696312    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"]
Nov 02 13:54:53.700141 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.700114    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.717742 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.716242    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-ee7df2\"/\"premium-w2-ee7df2-kserve-self-signed-certs\""
Nov 02 13:54:53.719311 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.719282    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"]
Nov 02 13:54:53.767665 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.767633    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tmp-dir\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.767871 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.767679    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-home\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.767871 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.767714    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-model-cache\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.767950 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.767885    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tls-certs\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.767989 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.767952    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j82t\" (UniqueName: \"kubernetes.io/projected/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-kube-api-access-7j82t\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.768045 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.768007    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-dshm\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.794506 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.794471    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:53.869685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.869650    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j82t\" (UniqueName: \"kubernetes.io/projected/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-kube-api-access-7j82t\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.869919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.869709    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-dshm\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.869919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.869782    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tmp-dir\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.869919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.869819    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-home\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.869919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.869859    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-model-cache\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.869919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.869917    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tls-certs\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.870749 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.870722    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tmp-dir\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.870941 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.870762    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-model-cache\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.870941 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.870792    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-home\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.873958 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.873493    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tls-certs\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.878613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.878569    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-dshm\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:53.884018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:53.883986    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j82t\" (UniqueName: \"kubernetes.io/projected/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-kube-api-access-7j82t\") pod \"premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") " pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:54.023324 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:54.023217    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:54.036583 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:54.036549    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:54.332665 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:54.332627    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"]
Nov 02 13:54:54.336381 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:54.336348    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16ea93ea_4058_40a9_84de_f32c9bd9dbb4.slice/crio-67233b36e83a656bac06b5693f5fd77e1efbbbfae8cdecf29e4fd82fab5429f7 WatchSource:0}: Error finding container 67233b36e83a656bac06b5693f5fd77e1efbbbfae8cdecf29e4fd82fab5429f7: Status 404 returned error can't find the container with id 67233b36e83a656bac06b5693f5fd77e1efbbbfae8cdecf29e4fd82fab5429f7
Nov 02 13:54:54.719632 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:54.719534    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:54.919712 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:54.919672    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" event={"ID":"16ea93ea-4058-40a9-84de-f32c9bd9dbb4","Type":"ContainerStarted","Data":"7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6"}
Nov 02 13:54:54.919913 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:54.919723    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" event={"ID":"16ea93ea-4058-40a9-84de-f32c9bd9dbb4","Type":"ContainerStarted","Data":"67233b36e83a656bac06b5693f5fd77e1efbbbfae8cdecf29e4fd82fab5429f7"}
Nov 02 13:54:54.943218 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:54.943154    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podStartSLOduration=1.943133983 podStartE2EDuration="1.943133983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:54.940779451 +0000 UTC m=+674.021924572" watchObservedRunningTime="2026-11-02 13:54:54.943133983 +0000 UTC m=+674.024279103"
Nov 02 13:54:55.023449 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:55.023364    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:54:55.517046 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:55.517010    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:56.014245 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.014211    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"]
Nov 02 13:54:56.018103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.018062    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.023815 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.023787    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7a9443\"/\"default-dockercfg-87xqh\""
Nov 02 13:54:56.024280 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.023819    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7a9443\"/\"kube-root-ca.crt\""
Nov 02 13:54:56.024280 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.023872    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7a9443\"/\"premium-w0-7a9443-kserve-self-signed-certs\""
Nov 02 13:54:56.026850 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.026806    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7a9443\"/\"openshift-service-ca.crt\""
Nov 02 13:54:56.032394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.032367    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"]
Nov 02 13:54:56.100941 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.100907    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:56.102159 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.102120    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-home\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.102309 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.102291    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-model-cache\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.102513 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.102324    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/231dcfc8-2f20-4320-af69-f0d190e5583a-tls-certs\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.102513 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.102383    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5skv\" (UniqueName: \"kubernetes.io/projected/231dcfc8-2f20-4320-af69-f0d190e5583a-kube-api-access-j5skv\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.102513 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.102493    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-dshm\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.102649 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.102524    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-tmp-dir\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.203737 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.203693    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-home\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.203937 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.203834    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-model-cache\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.203937 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.203863    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/231dcfc8-2f20-4320-af69-f0d190e5583a-tls-certs\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.203937 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.203904    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5skv\" (UniqueName: \"kubernetes.io/projected/231dcfc8-2f20-4320-af69-f0d190e5583a-kube-api-access-j5skv\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.204110 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.203941    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-dshm\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.204110 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.203977    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-tmp-dir\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.204283 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.204257    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-home\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.204360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.204284    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-model-cache\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.204360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.204347    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-tmp-dir\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.206689 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.206656    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-dshm\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.206836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.206731    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/231dcfc8-2f20-4320-af69-f0d190e5583a-tls-certs\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.217130 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.217102    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5skv\" (UniqueName: \"kubernetes.io/projected/231dcfc8-2f20-4320-af69-f0d190e5583a-kube-api-access-j5skv\") pod \"premium-w0-7a9443-kserve-ff649d86b-cdw9x\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") " pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.335460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.335417    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:56.410042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.409681    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:56.636038 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.636014    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"]
Nov 02 13:54:56.638113 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:54:56.638083    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod231dcfc8_2f20_4320_af69_f0d190e5583a.slice/crio-a1414a9a8cbd739340a25473d0be7b62027e90d7e81b22c9961b0eee86d3591e WatchSource:0}: Error finding container a1414a9a8cbd739340a25473d0be7b62027e90d7e81b22c9961b0eee86d3591e: Status 404 returned error can't find the container with id a1414a9a8cbd739340a25473d0be7b62027e90d7e81b22c9961b0eee86d3591e
Nov 02 13:54:56.935577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.935465    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" event={"ID":"231dcfc8-2f20-4320-af69-f0d190e5583a","Type":"ContainerStarted","Data":"e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315"}
Nov 02 13:54:56.935577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.935522    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" event={"ID":"231dcfc8-2f20-4320-af69-f0d190e5583a","Type":"ContainerStarted","Data":"a1414a9a8cbd739340a25473d0be7b62027e90d7e81b22c9961b0eee86d3591e"}
Nov 02 13:54:56.983947 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:56.983871    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podStartSLOduration=1.983854652 podStartE2EDuration="1.983854652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:56.981949825 +0000 UTC m=+676.063094945" watchObservedRunningTime="2026-11-02 13:54:56.983854652 +0000 UTC m=+676.064999806"
Nov 02 13:54:57.336460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:57.336424    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:54:57.341807 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:57.341772    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:57.885586 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:57.885551    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:57.899086 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:57.899037    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:57.954171 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:57.954132    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:54:58.288791 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:58.288753    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:54:59.474183 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:54:59.473245    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:00.513478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:00.513445    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:01.224676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:01.224629    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:01.432923 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:01.432880    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:02.022362 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:02.022323    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:02.026329 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:02.026292    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:55:02.041665 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:02.040886    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:55:02.813436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:02.813404    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:02.992917 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:02.992882    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:55:03.648571 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:03.648534    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:03.962325 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:03.962193    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:04.023669 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:04.023634    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:55:04.044339 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:04.044305    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:55:04.558344 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:04.558303    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:05.005738 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:05.005651    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:55:05.418601 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:05.418565    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:06.091655 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:55:06.091609    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:55:06.289952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:06.289897    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:06.336002 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:06.335968    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:55:06.350381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:06.350291    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:55:07.017866 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:07.017836    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:55:07.201180 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:07.201150    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:08.006603 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:08.006565    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:09.084545 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:09.084511    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:09.856725 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:09.856685    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:11.034373 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:11.034335    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:12.023858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:12.023816    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:13.021731 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:13.021695    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:14.319178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:14.319112    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:15.414832 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:15.414795    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:16.165274 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:16.165222    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:17.009091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:17.009041    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:17.805060 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:17.805006    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:18.655122 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:18.655051    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:19.409688 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:19.409655    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:20.210815 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:20.210778    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:21.331832 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:21.331796    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:22.396816 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:22.396756    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:23.412739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:23.412690    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:24.593021 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:24.592986    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:25.583656 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:25.583618    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:26.676530 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:26.676494    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:27.563726 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:27.563693    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:28.306742 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:28.306706    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:29.125650 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:29.125619    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:30.002636 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:30.002601    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:30.726432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:30.726401    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:31.514564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:31.514506    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:32.206971 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:32.206934    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:33.035540 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:33.035508    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:33.803985 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:33.803949    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:34.507807 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:34.507778    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:35.318574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:35.318535    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:36.086176 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:55:36.086139    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:55:36.205640 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:36.205602    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:37.014627 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:37.014592    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:37.676489 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:37.676444    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:37.905676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:37.905643    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:38.711457 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:38.711426    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:39.617408 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:39.617371    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:40.421016 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:40.420985    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:41.207827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:41.207779    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:41.916489 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:41.916457    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:42.630636 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:42.630589    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:43.384466 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:43.384420    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:44.096755 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:44.096725    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:45.084894 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:45.084827    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:45.948008 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:45.947969    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:46.713897 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:46.713854    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:47.702828 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:47.702770    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:48.587336 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:48.587296    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:49.386402 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:49.386364    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:50.301367 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:50.301324    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:51.313143 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:51.313091    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:51.925945 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:51.925914    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:52.126871 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:52.126833    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:53.002932 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:53.002892    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:53.913092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:53.912664    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:54.721794 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:54.721764    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:55.697533 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:55.697497    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:56.550196 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:56.550150    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:57.309440 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:57.309378    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:58.152662 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:58.152599    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:59.137019 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:59.136982    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:55:59.926631 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:55:59.926583    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:00.723928 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:00.723891    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:01.660843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:01.660811    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:02.503981 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:02.503942    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:03.319679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:03.319636    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:04.090665 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:04.090629    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:04.805798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:04.805761    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:05.580300 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:05.580235    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:06.123305 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:56:06.123263    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:56:06.595931 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:06.595888    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:07.404757 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:07.404626    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:08.651513 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:08.651474    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:09.508041 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:09.508004    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:09.675057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:09.675020    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:09.805554 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:09.805518    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:10.321216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:10.321178    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:11.058484 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:11.058449    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:12.083094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:12.082407    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:12.897950 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:12.897915    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:13.913381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:13.913345    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:14.708627 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:14.708579    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:15.595551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:15.595509    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:16.609901 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:16.609864    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:17.839058 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:17.839020    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:18.929129 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:18.929092    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:19.252667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:19.252570    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:19.818217 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:19.818180    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:20.229394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.229313    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"]
Nov 02 13:56:20.234211 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.234185    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.240189 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.240153    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-9e0c2f-openshift-default-dockercfg-xxct7\""
Nov 02 13:56:20.249779 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.249750    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"]
Nov 02 13:56:20.315637 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.315594    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6027d12-ebaa-4c79-b5b2-57766db2d805-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.315888 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.315754    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.315888 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.315798    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv6kr\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-kube-api-access-wv6kr\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.315888 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.315856    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.316057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.315920    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.316057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.315945    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.316057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.315996    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.316057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.316023    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.316661 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.316107    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.417745 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.417699    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.417745 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.417745    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv6kr\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-kube-api-access-wv6kr\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.417989 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.417806    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.417989 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.417838    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.417989 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.417916    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.417989 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.417962    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418250 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.417990    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418250 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.418038    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418250 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.418110    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6027d12-ebaa-4c79-b5b2-57766db2d805-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418250 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.418227    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418472 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.418413    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418536 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.418488    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418690 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.418665    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.418819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.418801    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6027d12-ebaa-4c79-b5b2-57766db2d805-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.420920 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.420895    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.421408 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.421379    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.431011 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.430978    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.431224 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.430981    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv6kr\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-kube-api-access-wv6kr\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.553049 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.553014    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:20.744450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.744408    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:20.758763 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.758719    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"]
Nov 02 13:56:20.763153 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.763128    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.767298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.767263    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-1d18fb-openshift-default-dockercfg-j42rt\""
Nov 02 13:56:20.791378 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.782879    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"]
Nov 02 13:56:20.822516 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822425    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.822516 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822468    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lnvf\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-kube-api-access-4lnvf\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.822516 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822488    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.822828 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822563    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.822828 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822609    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.822828 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822710    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.822828 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822744    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06e2fae-c590-42e1-854d-b30c9232dac8-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.823045 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822920    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.823045 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.822944    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.853937 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.853740    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"]
Nov 02 13:56:20.857802 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:56:20.857329    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6027d12_ebaa_4c79_b5b2_57766db2d805.slice/crio-8fd63b20095b18a0a1bbb0ae71ec2181c021eaef7781599e268e2bbdde710e11 WatchSource:0}: Error finding container 8fd63b20095b18a0a1bbb0ae71ec2181c021eaef7781599e268e2bbdde710e11: Status 404 returned error can't find the container with id 8fd63b20095b18a0a1bbb0ae71ec2181c021eaef7781599e268e2bbdde710e11
Nov 02 13:56:20.859737 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.859698    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:20.859866 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.859772    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:20.859866 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.859802    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:20.923879 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.923845    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.923879 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.923884    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924131    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924212 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924171    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lnvf\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-kube-api-access-4lnvf\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924212 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924196    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924314 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924222    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924314 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924241    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924314 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924282    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924314 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924310    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06e2fae-c590-42e1-854d-b30c9232dac8-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924653    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924776 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924753    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924818    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.924927 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.924907    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.925189 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.925022    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06e2fae-c590-42e1-854d-b30c9232dac8-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.926996 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.926974    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.927499 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.927482    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.938214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.938178    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:20.938398 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:20.938382    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lnvf\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-kube-api-access-4lnvf\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:21.092669 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.092548    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:21.394797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.394755    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"]
Nov 02 13:56:21.397387 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:56:21.397355    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06e2fae_c590_42e1_854d_b30c9232dac8.slice/crio-a1a7000dcdda450420ba0b508e884a4d56e05fcab521cc48e49ffe1f70e1a55a WatchSource:0}: Error finding container a1a7000dcdda450420ba0b508e884a4d56e05fcab521cc48e49ffe1f70e1a55a: Status 404 returned error can't find the container with id a1a7000dcdda450420ba0b508e884a4d56e05fcab521cc48e49ffe1f70e1a55a
Nov 02 13:56:21.400130 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.400090    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:21.400245 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.400183    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:21.400245 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.400233    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:21.611525 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.611486    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" event={"ID":"e06e2fae-c590-42e1-854d-b30c9232dac8","Type":"ContainerStarted","Data":"00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9"}
Nov 02 13:56:21.611819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.611556    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" event={"ID":"e06e2fae-c590-42e1-854d-b30c9232dac8","Type":"ContainerStarted","Data":"a1a7000dcdda450420ba0b508e884a4d56e05fcab521cc48e49ffe1f70e1a55a"}
Nov 02 13:56:21.614381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.614348    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" event={"ID":"f6027d12-ebaa-4c79-b5b2-57766db2d805","Type":"ContainerStarted","Data":"2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5"}
Nov 02 13:56:21.614491 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.614413    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" event={"ID":"f6027d12-ebaa-4c79-b5b2-57766db2d805","Type":"ContainerStarted","Data":"8fd63b20095b18a0a1bbb0ae71ec2181c021eaef7781599e268e2bbdde710e11"}
Nov 02 13:56:21.639160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.636385    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podStartSLOduration=1.636366444 podStartE2EDuration="1.636366444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:21.635028772 +0000 UTC m=+760.716173892" watchObservedRunningTime="2026-11-02 13:56:21.636366444 +0000 UTC m=+760.717511658"
Nov 02 13:56:21.683151 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.675498    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podStartSLOduration=1.675475966 podStartE2EDuration="1.675475966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:21.674245956 +0000 UTC m=+760.755391078" watchObservedRunningTime="2026-11-02 13:56:21.675475966 +0000 UTC m=+760.756621087"
Nov 02 13:56:21.792397 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:21.792348    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:22.094777 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:22.094717    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:22.102304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:22.102252    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 02 13:56:22.102638 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:22.102592    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 02 13:56:22.553519 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:22.553481    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:22.555182 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:22.555146    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 02 13:56:22.555448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:22.555414    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 02 13:56:23.097543 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:23.097506    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 02 13:56:23.097861 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:23.097829    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 02 13:56:23.249252 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:23.237660    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:23.554586 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:23.554544    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 02 13:56:23.555277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:23.555239    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 02 13:56:24.099113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:24.097711    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 02 13:56:24.099113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:24.097779    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 02 13:56:24.562097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:24.555719    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 02 13:56:24.562097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:24.555803    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 02 13:56:24.582098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:24.569861    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:25.098097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:25.097558    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 02 13:56:25.098097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:25.097625    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 02 13:56:25.555109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:25.553537    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 02 13:56:25.555109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:25.553609    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 02 13:56:25.914157 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:25.913364    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:26.096634 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:26.096590    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 02 13:56:26.096940 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:26.096906    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 02 13:56:26.555102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:26.553520    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 02 13:56:26.555102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:26.553586    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 02 13:56:27.026736 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:27.026643    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:27.101812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:27.101755    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 02 13:56:27.102177 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:27.102142    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 02 13:56:27.553575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:27.553531    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 02 13:56:27.553879 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:27.553850    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 02 13:56:28.022054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:28.021955    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:28.092998 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:28.092960    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 02 13:56:28.093518 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:28.093020    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 02 13:56:28.560822 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:28.560783    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:28.562323 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:28.562298    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:28.563250 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:28.563224    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 13:56:28.804134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:28.804102    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:29.098031 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:29.097991    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:29.098484 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:29.098281    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:29.099163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:29.099145    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 13:56:29.610587 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:29.610541    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:30.601571 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:30.601501    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:31.733226 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:31.733192    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:33.184110 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:33.175748    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:33.490772 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:33.490675    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:35.151612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.151571    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:35.520803 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.519935    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"]
Nov 02 13:56:35.534830 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.534796    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.560094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.553643    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"]
Nov 02 13:56:35.568096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.565515    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7a9443-openshift-default-dockercfg-m25kh\""
Nov 02 13:56:35.627770 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.627727    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f12575-5635-46a5-a432-679f24f5622a-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.632340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.632227    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.632667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.632641    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.632828 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.632811    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.644592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.644556    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.644781 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.644762    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.644978 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.644962    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.645171 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.645153    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f12575-5635-46a5-a432-679f24f5622a-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.652114 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.645333    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwjm5\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-kube-api-access-dwjm5\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.687223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.684126    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"]
Nov 02 13:56:35.736256 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.736210    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"]
Nov 02 13:56:35.740532 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.740491    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761423    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761484    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761513    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761584    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f12575-5635-46a5-a432-679f24f5622a-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761609    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761644    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761688    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwjm5\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-kube-api-access-dwjm5\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.761827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761719    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cm48\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-kube-api-access-2cm48\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761858    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f12575-5635-46a5-a432-679f24f5622a-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761888    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761921    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.761966    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.762254    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.762318    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.762345    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.762395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.762392    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.762808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.762427    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.762808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.762513    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.766145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.763632    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.766145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.763697    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.766145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.763945    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.769831 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.769458    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-1eb567-openshift-default-dockercfg-lpvp4\""
Nov 02 13:56:35.770784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.770708    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f12575-5635-46a5-a432-679f24f5622a-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.771260 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.771204    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.782891 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.782774    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.810858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.810821    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwjm5\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-kube-api-access-dwjm5\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.811761 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.811728    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f12575-5635-46a5-a432-679f24f5622a-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.818116 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.818087    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:35.865889 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.864618    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.866517 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.865935    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.866651 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.865838    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.867138 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.867109    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cm48\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-kube-api-access-2cm48\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.867253 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.867226    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.867619 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.867595    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.867722 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.867262    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.867964 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.867939    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.868145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.868124    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.868432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.868410    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.868526 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.868494    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.868848 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.868735    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.869435 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.869414    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.869611 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.869580    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.869788 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.869601    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.872733 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.872703    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.889323 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.889294    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.889603 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.889587    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cm48\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-kube-api-access-2cm48\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:35.996592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:35.995866    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"]
Nov 02 13:56:36.001794 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.001752    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.011235 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.011202    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-f2e945-openshift-default-dockercfg-d2ckm\""
Nov 02 13:56:36.018678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.018641    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"]
Nov 02 13:56:36.026458 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.023268    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:36.072416 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072376    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072448    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072476    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072527    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/105ffa58-e906-4ad5-b587-cf3245cc1c03-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072555    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcnnt\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-kube-api-access-kcnnt\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072588    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072621    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072661    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.072961 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.072682    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.116218 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:56:36.116175    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:56:36.160379 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.160339    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174106    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174160    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174254    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174309    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174350    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174400    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/105ffa58-e906-4ad5-b587-cf3245cc1c03-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174443    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcnnt\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-kube-api-access-kcnnt\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174489    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174538    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.176042 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.174981    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.179704 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.179671    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.180826 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.180788    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.182241 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.182209    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/105ffa58-e906-4ad5-b587-cf3245cc1c03-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.182544 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.182516    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.183115 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.183040    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.186900 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.186837    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.203517 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.203457    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.205573 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.205515    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcnnt\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-kube-api-access-kcnnt\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.327716 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.327681    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:36.358102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.358003    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"]
Nov 02 13:56:36.359312 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:56:36.359267    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f12575_5635_46a5_a432_679f24f5622a.slice/crio-1c1d2b70363621e0dd27e5e582a2f8a63ecac19a2e80920dcd00478cf801a517 WatchSource:0}: Error finding container 1c1d2b70363621e0dd27e5e582a2f8a63ecac19a2e80920dcd00478cf801a517: Status 404 returned error can't find the container with id 1c1d2b70363621e0dd27e5e582a2f8a63ecac19a2e80920dcd00478cf801a517
Nov 02 13:56:36.362934 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.362851    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.363149 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.363026    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.363149 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.363097    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.475953 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.475909    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"]
Nov 02 13:56:36.485759 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.485692    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.485982 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.485953    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.486112 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.486019    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.648823 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:56:36.648765    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105ffa58_e906_4ad5_b587_cf3245cc1c03.slice/crio-e747051b7a8980e1bad6849083a7af5d699acf563c38cc358cc4823488b3504f WatchSource:0}: Error finding container e747051b7a8980e1bad6849083a7af5d699acf563c38cc358cc4823488b3504f: Status 404 returned error can't find the container with id e747051b7a8980e1bad6849083a7af5d699acf563c38cc358cc4823488b3504f
Nov 02 13:56:36.653288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.652759    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"]
Nov 02 13:56:36.657146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.655903    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.657146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.656011    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.657146 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.656096    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:36.857597 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.857543    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" event={"ID":"b9f12575-5635-46a5-a432-679f24f5622a","Type":"ContainerStarted","Data":"08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914"}
Nov 02 13:56:36.857804 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.857632    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" event={"ID":"b9f12575-5635-46a5-a432-679f24f5622a","Type":"ContainerStarted","Data":"1c1d2b70363621e0dd27e5e582a2f8a63ecac19a2e80920dcd00478cf801a517"}
Nov 02 13:56:36.873099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.869230    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" event={"ID":"105ffa58-e906-4ad5-b587-cf3245cc1c03","Type":"ContainerStarted","Data":"03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60"}
Nov 02 13:56:36.873099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.869336    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" event={"ID":"105ffa58-e906-4ad5-b587-cf3245cc1c03","Type":"ContainerStarted","Data":"e747051b7a8980e1bad6849083a7af5d699acf563c38cc358cc4823488b3504f"}
Nov 02 13:56:36.884971 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.884044    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" event={"ID":"0927ad0d-be5d-40a9-9ba0-5369ba0388c0","Type":"ContainerStarted","Data":"1bf042ec812b36507d9f7adecf80e4fbed76f36478d4cb2ec4465e19b2c2a2e4"}
Nov 02 13:56:36.884971 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.884190    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" event={"ID":"0927ad0d-be5d-40a9-9ba0-5369ba0388c0","Type":"ContainerStarted","Data":"9aa7fca3e72effb4378725a6fdb44e65bbe3a9f632aded4e78d5f5b5ee76d79e"}
Nov 02 13:56:36.987528 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:36.987432    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:37.024014 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.023983    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:37.028919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.027113    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podStartSLOduration=2.027097914 podStartE2EDuration="2.027097914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:36.948472693 +0000 UTC m=+776.029617816" watchObservedRunningTime="2026-11-02 13:56:37.027097914 +0000 UTC m=+776.108243033"
Nov 02 13:56:37.029125 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.029020    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 02 13:56:37.029125 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.029102    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 02 13:56:37.082127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.081844    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podStartSLOduration=2.081824121 podStartE2EDuration="2.081824121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:37.080161509 +0000 UTC m=+776.161306707" watchObservedRunningTime="2026-11-02 13:56:37.081824121 +0000 UTC m=+776.162969244"
Nov 02 13:56:37.083459 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.083406    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podStartSLOduration=2.083386467 podStartE2EDuration="2.083386467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:37.036277971 +0000 UTC m=+776.117423092" watchObservedRunningTime="2026-11-02 13:56:37.083386467 +0000 UTC m=+776.164531588"
Nov 02 13:56:37.161551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.161513    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:37.163249 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.163212    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:37.163442 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.163283    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:37.328197 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.328147    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:37.329898 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.329867    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 02 13:56:37.330084 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:37.329931    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 02 13:56:38.025951 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:38.025908    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 02 13:56:38.026290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:38.026256    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 02 13:56:38.174527 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:38.174487    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:38.176969 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:38.176926    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:38.177626 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:38.176702    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:38.332096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:38.328441    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 02 13:56:38.332096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:38.328512    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 02 13:56:39.026739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:39.025480    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 02 13:56:39.026739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:39.025555    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 02 13:56:39.163100 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:39.162481    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:39.163100 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:39.162547    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:39.332120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:39.331687    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 02 13:56:39.332120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:39.331751    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 02 13:56:39.429123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:39.426543    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:40.028995 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:40.028520    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 02 13:56:40.028995 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:40.028586    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 02 13:56:40.164678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:40.164628    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:40.165024 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:40.164977    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:40.332163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:40.331514    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 02 13:56:40.332163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:40.331592    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 02 13:56:40.979099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:40.975708    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:41.072098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:41.060441    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 02 13:56:41.072098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:41.060526    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 02 13:56:41.191012 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:41.190974    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:41.191366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:41.191320    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:41.329091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:41.328350    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 02 13:56:41.329091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:41.328450    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 02 13:56:42.033876 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:42.033817    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 02 13:56:42.058143 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:42.043132    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 02 13:56:42.190096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:42.185585    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:42.190096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:42.185684    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:42.328515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:42.328344    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 02 13:56:42.328515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:42.328428    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 02 13:56:42.436534 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:42.436464    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:43.041101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:43.035021    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 02 13:56:43.155102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:43.154142    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 02 13:56:43.167093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:43.163253    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:43.167093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:43.163339    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:43.329163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:43.328852    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 02 13:56:43.329163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:43.328934    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 02 13:56:43.611645 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:43.611540    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:44.162258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.162220    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 02 13:56:44.162910 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.162876    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 02 13:56:44.442163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.435821    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:44.442163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.438599    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:44.442163 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.440063    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 13:56:44.608567 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.608524    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:44.834427 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.834393    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:44.835632 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.835602    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:44.836766 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:44.836734    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 13:56:45.166792 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:45.166704    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:45.167269 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:45.167110    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:45.168035 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:45.168014    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 13:56:45.671827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:45.671792    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:46.646579 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:46.646545    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:47.626637 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:47.626601    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:47.841239 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:47.841037    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:48.805801 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:48.805737    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:50.145208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.145158    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:50.167090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.164929    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"]
Nov 02 13:56:50.176392 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.176354    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.188647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.188558    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-ee7df2-openshift-default-dockercfg-hc6nm\""
Nov 02 13:56:50.202726 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.202692    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"]
Nov 02 13:56:50.316758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.316704    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj2wd\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-kube-api-access-nj2wd\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.317148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.317119    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aac832da-523d-4f2e-b231-a13faa06d78d-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.317385 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.317355    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.317559 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.317541    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.317707 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.317690    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aac832da-523d-4f2e-b231-a13faa06d78d-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.317900 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.317867    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.318048 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.318031    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.318239 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.318211    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.318459 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.318440    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.422698    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.423388    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.423697    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj2wd\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-kube-api-access-nj2wd\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.424246    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aac832da-523d-4f2e-b231-a13faa06d78d-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.426175    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.425709    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.426291    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.426891    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aac832da-523d-4f2e-b231-a13faa06d78d-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.426964    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.426999    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.427044    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.427889    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aac832da-523d-4f2e-b231-a13faa06d78d-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.428329    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.428871    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.431277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.430031    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aac832da-523d-4f2e-b231-a13faa06d78d-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.450137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.449179    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.455795 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.455748    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj2wd\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-kube-api-access-nj2wd\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.461047 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.460948    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.556860 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.556636    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:50.910060 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.910024    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"]
Nov 02 13:56:50.911234 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:56:50.911197    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac832da_523d_4f2e_b231_a13faa06d78d.slice/crio-5594819be820962c044d749df670f414b7701998fbeb6e5a408321f438d78d7f WatchSource:0}: Error finding container 5594819be820962c044d749df670f414b7701998fbeb6e5a408321f438d78d7f: Status 404 returned error can't find the container with id 5594819be820962c044d749df670f414b7701998fbeb6e5a408321f438d78d7f
Nov 02 13:56:50.915237 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.915191    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:50.915365 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.915295    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:50.915365 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:50.915355    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:56:51.098055 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.098000    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:51.340401 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.340357    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" event={"ID":"aac832da-523d-4f2e-b231-a13faa06d78d","Type":"ContainerStarted","Data":"b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69"}
Nov 02 13:56:51.340882 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.340467    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" event={"ID":"aac832da-523d-4f2e-b231-a13faa06d78d","Type":"ContainerStarted","Data":"5594819be820962c044d749df670f414b7701998fbeb6e5a408321f438d78d7f"}
Nov 02 13:56:51.367127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.367048    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podStartSLOduration=1.367032191 podStartE2EDuration="1.367032191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:51.36672646 +0000 UTC m=+790.447871580" watchObservedRunningTime="2026-11-02 13:56:51.367032191 +0000 UTC m=+790.448177311"
Nov 02 13:56:51.557218 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.557173    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:51.677370 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.674454    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"]
Nov 02 13:56:51.679738 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.679705    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.691495 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.690744    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-4fc49b\"/\"distinct-w3-4fc49b-kserve-self-signed-certs\""
Nov 02 13:56:51.695326 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.695229    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"]
Nov 02 13:56:51.757662 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.757627    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:51.776443 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.776399    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-home\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.776695 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.776679    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tmp-dir\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.776840 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.776824    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-dshm\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.776945 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.776930    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w2jx\" (UniqueName: \"kubernetes.io/projected/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-kube-api-access-5w2jx\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.777223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.777202    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-model-cache\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.777479 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.777463    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tls-certs\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.880267 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.880229    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tls-certs\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.881084 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.881038    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-home\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.881701 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.881682    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tmp-dir\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.882200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.882184    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-dshm\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.882677 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.882657    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w2jx\" (UniqueName: \"kubernetes.io/projected/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-kube-api-access-5w2jx\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.883245 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.883226    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-model-cache\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.894591 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.881627    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-home\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.894871 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.882112    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tmp-dir\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.894975 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.883626    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-model-cache\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.899295 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.899260    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w2jx\" (UniqueName: \"kubernetes.io/projected/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-kube-api-access-5w2jx\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.935541 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.935462    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tls-certs\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:51.936005 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:51.935980    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-dshm\") pod \"distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") " pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:52.017674 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:52.016373    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:52.082117 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:52.081699    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:52.279748 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:52.279721    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:52.379392 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:52.379359    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"]
Nov 02 13:56:52.381820 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:56:52.381775    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b1bdb2c_fae4_4fcf_9e9c_b57829e49deb.slice/crio-7a00593c4a76118c46c7dded2c1071e3f1e75b7847276873221656722bbab4f2 WatchSource:0}: Error finding container 7a00593c4a76118c46c7dded2c1071e3f1e75b7847276873221656722bbab4f2: Status 404 returned error can't find the container with id 7a00593c4a76118c46c7dded2c1071e3f1e75b7847276873221656722bbab4f2
Nov 02 13:56:52.562160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:52.562021    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 02 13:56:52.562160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:52.562132    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 02 13:56:53.374095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:53.371207    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:53.389219 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:53.389157    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" event={"ID":"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb","Type":"ContainerStarted","Data":"e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f"}
Nov 02 13:56:53.389219 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:53.389199    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" event={"ID":"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb","Type":"ContainerStarted","Data":"7a00593c4a76118c46c7dded2c1071e3f1e75b7847276873221656722bbab4f2"}
Nov 02 13:56:53.418272 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:53.418222    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podStartSLOduration=2.418205878 podStartE2EDuration="2.418205878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:53.417201539 +0000 UTC m=+792.498346660" watchObservedRunningTime="2026-11-02 13:56:53.418205878 +0000 UTC m=+792.499350997"
Nov 02 13:56:53.563090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:53.559553    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 02 13:56:53.563090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:53.559635    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 02 13:56:54.019090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:54.018171    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:56:54.464096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:54.463129    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:54.559113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:54.557541    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 02 13:56:54.559113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:54.557610    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 02 13:56:54.602616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:54.602579    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:55.495348 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:55.495304    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:55.565299 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:55.565262    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 02 13:56:55.565622 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:55.565592    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 02 13:56:56.529260 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:56.529222    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:56.561132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:56.557551    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 02 13:56:56.561132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:56.557615    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 02 13:56:57.324321 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:57.324286    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:57.558088 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:57.558029    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Nov 02 13:56:57.558562 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:57.558165    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Nov 02 13:56:58.247629 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:58.247597    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:56:58.563177 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:58.563134    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:58.563684 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:58.563480    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:58.564499 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:58.564467    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 13:56:59.307636 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:56:59.307598    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:00.200205 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:00.200139    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:01.055290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:01.055252    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:02.018155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.018105    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:57:02.033909 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.033878    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:57:02.203012 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.202975    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:02.319099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.308964    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"]
Nov 02 13:57:02.350825 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.350668    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"]
Nov 02 13:57:02.351218 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.351194    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.446388 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.446352    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"openshift-service-ca.crt\""
Nov 02 13:57:02.447184 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.447162    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"default-dockercfg-ffm7d\""
Nov 02 13:57:02.447504 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.447488    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"kube-root-ca.crt\""
Nov 02 13:57:02.447732 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.446658    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"distinct-2-w1-f2e945-kserve-self-signed-certs\""
Nov 02 13:57:02.450174 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.450153    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tls-certs\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.450457 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.450439    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-model-cache\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.450720 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.450699    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-dshm\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.450980 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.450960    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tmp-dir\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.451242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.451225    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-home\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.451407 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.451388    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28qtl\" (UniqueName: \"kubernetes.io/projected/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-kube-api-access-28qtl\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.465831 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.465183    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:02.508606 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.508577    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.556723    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tmp-dir\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.556797    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-home\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.556824    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28qtl\" (UniqueName: \"kubernetes.io/projected/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-kube-api-access-28qtl\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.556946    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tls-certs\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.556984    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-model-cache\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.557044    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-dshm\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.557878    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tmp-dir\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.560137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.558145    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-home\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.578810 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.576843    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-model-cache\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.654090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.631978    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28qtl\" (UniqueName: \"kubernetes.io/projected/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-kube-api-access-28qtl\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.654090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.635130    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tls-certs\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.654090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.646544    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-dshm\") pod \"distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") " pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:02.795629 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:02.795308    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:03.708999 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:03.708956    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"]
Nov 02 13:57:03.910097 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:57:03.908498    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6de45f8c_8886_4505_9ac6_6b0b01cb4f04.slice/crio-252eb37aa67e6a160d919492004c58e69095a04c6d85423503e266b1f584ead5 WatchSource:0}: Error finding container 252eb37aa67e6a160d919492004c58e69095a04c6d85423503e266b1f584ead5: Status 404 returned error can't find the container with id 252eb37aa67e6a160d919492004c58e69095a04c6d85423503e266b1f584ead5
Nov 02 13:57:04.424974 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:04.424854    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:04.612832 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:04.612791    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" event={"ID":"6de45f8c-8886-4505-9ac6-6b0b01cb4f04","Type":"ContainerStarted","Data":"70c6f4a01527dbf852f6eb78e9893d26a7703f593701129eb62079a647d35a04"}
Nov 02 13:57:04.613048 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:04.612845    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" event={"ID":"6de45f8c-8886-4505-9ac6-6b0b01cb4f04","Type":"ContainerStarted","Data":"252eb37aa67e6a160d919492004c58e69095a04c6d85423503e266b1f584ead5"}
Nov 02 13:57:04.634288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:04.633637    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podStartSLOduration=2.633621399 podStartE2EDuration="2.633621399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:04.632766252 +0000 UTC m=+803.713911375" watchObservedRunningTime="2026-11-02 13:57:04.633621399 +0000 UTC m=+803.714766521"
Nov 02 13:57:04.801220 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:04.801177    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:05.454211 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.454175    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"]
Nov 02 13:57:05.466298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.461176    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.480491 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.480459    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"]
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556098    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vffk5\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-kube-api-access-vffk5\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556165    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556199    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556273    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556341    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556378    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556417    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556548    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.556578    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.558135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.557053    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:05.658028 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.657988    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658058    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658140    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658172    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658260    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658319 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658276    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658339    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vffk5\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-kube-api-access-vffk5\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658358    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658612 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658379    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.658843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.658820    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.659712 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.659678    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.660178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.660148    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.660335 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.660313    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.665125 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.661054    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.665125 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.662686    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.665125 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.664268    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.674174 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.674142    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vffk5\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-kube-api-access-vffk5\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.682247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.682209    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.698614 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.698575    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:05.806474 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.806245    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:05.872237 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.872195    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"]
Nov 02 13:57:05.882264 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.879324    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.906202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.899397    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"]
Nov 02 13:57:05.979591 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979538    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.979820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979640    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.979820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979722    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.979820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979758    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.979820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979802    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.980049 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979824    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.980049 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979859    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g87l4\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-kube-api-access-g87l4\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.980049 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979961    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:05.980049 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:05.979996    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36f97e8c-874a-43b3-ab70-10d2984d41a6-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081359 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081251    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081359 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081309    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36f97e8c-874a-43b3-ab70-10d2984d41a6-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081412    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081477    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081577    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081616 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081608    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081663    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081686    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081724    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g87l4\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-kube-api-access-g87l4\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.081849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.081756    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.082061 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.082025    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.082145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.082114    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.082727 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.082698    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.083624 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.083597    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36f97e8c-874a-43b3-ab70-10d2984d41a6-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.085035 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.085011    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.086516 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.086490    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.088639 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:57:06.088613    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:57:06.094365 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.094334    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.101788 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.101754    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g87l4\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-kube-api-access-g87l4\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.123556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.123517    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"]
Nov 02 13:57:06.125181 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:57:06.125147    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea077ddb_105f_4fc6_9c8f_c1d890ba42c9.slice/crio-d6e81ae5abf258603a2197db8a4db2795437c8dabb8aa8e1969f6c6c7dcc806d WatchSource:0}: Error finding container d6e81ae5abf258603a2197db8a4db2795437c8dabb8aa8e1969f6c6c7dcc806d: Status 404 returned error can't find the container with id d6e81ae5abf258603a2197db8a4db2795437c8dabb8aa8e1969f6c6c7dcc806d
Nov 02 13:57:06.127921 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.127877    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:06.128032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.127951    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:06.128032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.127985    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:06.219144 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.219105    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:06.422836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.422740    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:06.536044 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.536016    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"]
Nov 02 13:57:06.539170 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:57:06.539137    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f97e8c_874a_43b3_ab70_10d2984d41a6.slice/crio-768c8d07dd6ab3ef07b75eedfb30392c9fc00178783a6837129459c2c77edc9e WatchSource:0}: Error finding container 768c8d07dd6ab3ef07b75eedfb30392c9fc00178783a6837129459c2c77edc9e: Status 404 returned error can't find the container with id 768c8d07dd6ab3ef07b75eedfb30392c9fc00178783a6837129459c2c77edc9e
Nov 02 13:57:06.542511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.542469    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:06.542644 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.542558    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:06.542644 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.542625    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:06.636109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.636039    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" event={"ID":"36f97e8c-874a-43b3-ab70-10d2984d41a6","Type":"ContainerStarted","Data":"768c8d07dd6ab3ef07b75eedfb30392c9fc00178783a6837129459c2c77edc9e"}
Nov 02 13:57:06.639416 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.639381    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" event={"ID":"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9","Type":"ContainerStarted","Data":"e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8"}
Nov 02 13:57:06.639596 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.639440    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" event={"ID":"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9","Type":"ContainerStarted","Data":"d6e81ae5abf258603a2197db8a4db2795437c8dabb8aa8e1969f6c6c7dcc806d"}
Nov 02 13:57:06.807399 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:06.807363    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:07.430620 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:07.430586    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:07.705155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:07.700741    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" event={"ID":"36f97e8c-874a-43b3-ab70-10d2984d41a6","Type":"ContainerStarted","Data":"b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c"}
Nov 02 13:57:07.731004 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:07.730941    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podStartSLOduration=2.730913002 podStartE2EDuration="2.730913002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:06.676272041 +0000 UTC m=+805.757417167" watchObservedRunningTime="2026-11-02 13:57:07.730913002 +0000 UTC m=+806.812058124"
Nov 02 13:57:07.734054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:07.734000    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podStartSLOduration=2.733984253 podStartE2EDuration="2.733984253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:07.72980497 +0000 UTC m=+806.810950093" watchObservedRunningTime="2026-11-02 13:57:07.733984253 +0000 UTC m=+806.815129372"
Nov 02 13:57:07.811283 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:07.811239    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 02 13:57:07.811790 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:07.811303    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 02 13:57:08.219702 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:08.219595    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:08.221084 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:08.221043    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 02 13:57:08.221175 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:08.221112    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 02 13:57:08.516739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:08.516653    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:08.809615 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:08.809574    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 02 13:57:08.809925 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:08.809885    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 02 13:57:09.219726 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:09.219633    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 02 13:57:09.220248 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:09.219846    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 02 13:57:09.509148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:09.508616    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:09.811090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:09.808495    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 02 13:57:09.811090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:09.808561    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 02 13:57:10.220107 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:10.219972    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 02 13:57:10.220107 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:10.220034    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 02 13:57:10.563094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:10.559567    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:10.808222 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:10.808179    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 02 13:57:10.808414 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:10.808244    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 02 13:57:11.221602 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:11.220844    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 02 13:57:11.221602 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:11.220927    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 02 13:57:11.760095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:11.759753    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:11.809098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:11.807538    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 02 13:57:11.809098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:11.807607    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 02 13:57:12.220056 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:12.220020    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 02 13:57:12.220246 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:12.220106    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 02 13:57:12.797260 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:12.797216    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:12.806808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:12.806768    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 02 13:57:12.807120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:12.806839    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 02 13:57:12.813219 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:12.813186    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:12.962875 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:12.962839    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:13.223198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:13.222999    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 02 13:57:13.223198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:13.223150    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 02 13:57:13.799830 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:13.799774    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:13.803550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:13.803523    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:13.812050 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:13.812021    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:13.812773 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:13.812747    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:13.814282 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:13.814260    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 13:57:14.397470 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:14.397439    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:14.397812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:14.397789    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:14.399192 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:14.399168    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 13:57:14.660018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:14.659915    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:15.606420 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:15.606382    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:16.430825 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:16.430777    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:16.837259 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:16.837213    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:17.365578 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:17.365544    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:18.188551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:18.188513    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:18.997570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:18.997534    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:20.248401 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.248276    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"]
Nov 02 13:57:20.255417 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.255373    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.285610 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.283468    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"]
Nov 02 13:57:20.357508 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357474    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357694 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357541    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357694 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357660    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357704    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt84b\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-kube-api-access-xt84b\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357736    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84dfe184-d563-489e-a953-1be14a11d4b0-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357757    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357947 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357824    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84dfe184-d563-489e-a953-1be14a11d4b0-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357947 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357858    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.357947 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.357884    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.458973 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.458926    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.459231 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.458999    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt84b\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-kube-api-access-xt84b\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.459231 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.459056    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84dfe184-d563-489e-a953-1be14a11d4b0-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.459849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.459745    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84dfe184-d563-489e-a953-1be14a11d4b0-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.459982 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.459832    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.459982 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.459963    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84dfe184-d563-489e-a953-1be14a11d4b0-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460115 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460012    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460115 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460053    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460226 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460145    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460226 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460200    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460902 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460557    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460902 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460577    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460902 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460765    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.460902 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.460815    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.462028 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.461988    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.463173 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.463143    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84dfe184-d563-489e-a953-1be14a11d4b0-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.472285 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.472241    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt84b\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-kube-api-access-xt84b\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.472490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.472466    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.582718 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.582676    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:20.589444 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.589416    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"]
Nov 02 13:57:20.594344 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.594309    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.619059 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.619025    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"]
Nov 02 13:57:20.669478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.669430    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.669706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.669503    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.669706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.669539    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fa4536-b2b1-405f-a330-153023466f94-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.669706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.669685    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmt9\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-kube-api-access-cqmt9\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.669890 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.669846    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.669949 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.669897    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.670043 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.669983    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fa4536-b2b1-405f-a330-153023466f94-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.670132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.670061    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.670193 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.670138    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.771911 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.771868    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772114 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.771922    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772114 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772053    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fa4536-b2b1-405f-a330-153023466f94-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772141    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmt9\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-kube-api-access-cqmt9\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772285 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772269    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772305    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772331 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772311    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772339    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fa4536-b2b1-405f-a330-153023466f94-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772381    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772458 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772411    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772541 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772521    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772823 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772789    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.772916 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.772873    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.773099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.773048    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fa4536-b2b1-405f-a330-153023466f94-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.775758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.775724    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.775958 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.775941    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fa4536-b2b1-405f-a330-153023466f94-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.786186 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.786158    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmt9\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-kube-api-access-cqmt9\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.786343 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.786296    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:20.917892 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.917795    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"]
Nov 02 13:57:20.932806 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.932768    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:20.932941 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.932848    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:20.932941 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.932876    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:20.935801 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:20.935775    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:21.008901 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.008778    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:21.271579 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.271540    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"]
Nov 02 13:57:21.273362 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:57:21.273327    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88fa4536_b2b1_405f_a330_153023466f94.slice/crio-ff6b58b7d19ceb303a559767274cad100cab1785840a3a29c63313c49883e6db WatchSource:0}: Error finding container ff6b58b7d19ceb303a559767274cad100cab1785840a3a29c63313c49883e6db: Status 404 returned error can't find the container with id ff6b58b7d19ceb303a559767274cad100cab1785840a3a29c63313c49883e6db
Nov 02 13:57:21.276974 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.276932    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:21.277047 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.277025    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:21.277149 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.277097    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:21.769132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.766697    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:21.877549 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.877497    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" event={"ID":"84dfe184-d563-489e-a953-1be14a11d4b0","Type":"ContainerStarted","Data":"52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb"}
Nov 02 13:57:21.877741 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.877578    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" event={"ID":"84dfe184-d563-489e-a953-1be14a11d4b0","Type":"ContainerStarted","Data":"ed33699e82d1f599bf2d7d0f5dc20f53b76afe63cd616d3c52d3d59cebb8be0f"}
Nov 02 13:57:21.880298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.879710    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" event={"ID":"88fa4536-b2b1-405f-a330-153023466f94","Type":"ContainerStarted","Data":"0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66"}
Nov 02 13:57:21.880298 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.879785    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" event={"ID":"88fa4536-b2b1-405f-a330-153023466f94","Type":"ContainerStarted","Data":"ff6b58b7d19ceb303a559767274cad100cab1785840a3a29c63313c49883e6db"}
Nov 02 13:57:21.914286 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.914231    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podStartSLOduration=1.914210945 podStartE2EDuration="1.914210945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:21.91165022 +0000 UTC m=+820.992795342" watchObservedRunningTime="2026-11-02 13:57:21.914210945 +0000 UTC m=+820.995356066"
Nov 02 13:57:21.944258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.942403    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:21.944258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:21.942858    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podStartSLOduration=1.942838675 podStartE2EDuration="1.942838675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:21.935247967 +0000 UTC m=+821.016393088" watchObservedRunningTime="2026-11-02 13:57:21.942838675 +0000 UTC m=+821.023983783"
Nov 02 13:57:22.593882 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:22.593840    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:22.598251 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:22.598212    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:22.598549 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:22.598514    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:22.934478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:22.934394    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:22.945086 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:22.945023    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:22.945380 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:22.945345    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:23.585097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:23.584550    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:23.585097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:23.584617    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:23.932310 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:23.932220    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:23.942093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:23.937190    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:23.942093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:23.937249    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:24.638107 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:24.635432    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:24.638107 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:24.635510    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:25.021150 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:25.008427    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:25.031258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:25.022037    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:25.118211 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:25.115828    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:25.592730 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:25.592674    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:25.593039 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:25.593008    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:25.959461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:25.959364    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:25.959461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:25.959435    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:26.483099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:26.468337    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:26.598092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:26.596564    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:26.598092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:26.596659    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:27.001675 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:26.992386    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:27.001675 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:26.992463    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:27.494097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.493411    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:27.638098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.598236    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:27.649098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.643401    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:27.662237 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.662172    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:27.786316 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.786274    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:57:27.939095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.938646    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:27.939095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.938734    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:27.999315 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:27.999263    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:28.230169 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.229890    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"]
Nov 02 13:57:28.266093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.265753    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.373096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.372226    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7a9443\"/\"distinct-w0-7a9443-kserve-self-signed-certs\""
Nov 02 13:57:28.425099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.423116    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-dshm\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.425099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.423413    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-tmp-dir\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.425099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.423605    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97ttx\" (UniqueName: \"kubernetes.io/projected/f419c032-58c1-4b81-809d-25af9d31453e-kube-api-access-97ttx\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.425099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.423672    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f419c032-58c1-4b81-809d-25af9d31453e-tls-certs\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.425099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.423952    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-home\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.425099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.424018    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-model-cache\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.425776 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.425320    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:28.451096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.444287    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"]
Nov 02 13:57:28.607676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.557542    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-dshm\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.607676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.557665    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-tmp-dir\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.607676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.557740    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ttx\" (UniqueName: \"kubernetes.io/projected/f419c032-58c1-4b81-809d-25af9d31453e-kube-api-access-97ttx\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.607676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.557783    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f419c032-58c1-4b81-809d-25af9d31453e-tls-certs\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.607676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.557861    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-home\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.607676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.557893    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-model-cache\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.607676 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.558459    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-model-cache\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.708675 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.708639    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-tmp-dir\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.710741 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.710711    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-home\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.731316 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.713148    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:28.731628 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.731591    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:28.768134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.751152    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f419c032-58c1-4b81-809d-25af9d31453e-tls-certs\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.768436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.757870    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-dshm\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.815096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.788153    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:28.815096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.789297    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:28.815096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.789588    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:28.878167 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.852812    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97ttx\" (UniqueName: \"kubernetes.io/projected/f419c032-58c1-4b81-809d-25af9d31453e-kube-api-access-97ttx\") pod \"distinct-w0-7a9443-kserve-859db8b8b9-9vgxr\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:28.893596 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.893223    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/health\": context deadline exceeded"
Nov 02 13:57:28.940814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.940320    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:28.940814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.940391    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:28.960090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.960017    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:28.987610 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:28.987470    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:29.007746 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.007661    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:57:29.009846 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.009809    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:57:29.022154 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.013807    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:29.077547 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.077513    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:29.496158 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.489214    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:29.616242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.588012    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:29.616242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.588095    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:29.724571 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.722544    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:29.790749 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.790687    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:29.792057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.792014    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:57:29.792673 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.792653    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:57:29.813057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.813026    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:29.918443 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:29.899034    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:30.100154 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.052595    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:57:30.100154 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.052679    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:30.123657 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.123597    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:57:30.174120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.133841    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:57:30.174120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.134371    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:57:30.174120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.136834    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:57:30.174120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.140243    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:57:30.174120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.141440    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:30.174120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.141500    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:30.250880 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:57:30.250843    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf419c032_58c1_4b81_809d_25af9d31453e.slice/crio-02e3ba17978721e60ebd136be0ef96f957beea5daf5a762602e4cb25d5ba49fd WatchSource:0}: Error finding container 02e3ba17978721e60ebd136be0ef96f957beea5daf5a762602e4cb25d5ba49fd: Status 404 returned error can't find the container with id 02e3ba17978721e60ebd136be0ef96f957beea5daf5a762602e4cb25d5ba49fd
Nov 02 13:57:30.372364 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.372297    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"]
Nov 02 13:57:30.372998 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.372966    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:57:30.378166 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.377760    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:57:30.646424 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.644665    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 02 13:57:30.646424 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.644720    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 02 13:57:30.716401 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.715624    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:30.731650 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.731618    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:57:30.740167 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.740141    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:57:30.740383 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.740364    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" event={"ID":"f419c032-58c1-4b81-809d-25af9d31453e","Type":"ContainerStarted","Data":"02e3ba17978721e60ebd136be0ef96f957beea5daf5a762602e4cb25d5ba49fd"}
Nov 02 13:57:30.764340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.764306    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"]
Nov 02 13:57:30.773118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.773088    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:30.783583 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.783504    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-1d18fb\"/\"distinct-2-w5-1d18fb-kserve-self-signed-certs\""
Nov 02 13:57:30.969706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.968836    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czfjl\" (UniqueName: \"kubernetes.io/projected/59c0dd7f-56f0-4fba-bc05-3d831ea90471-kube-api-access-czfjl\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:30.969706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.968895    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-model-cache\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:30.969706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.968930    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tls-certs\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:30.969706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.968966    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-dshm\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:30.969706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.969009    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tmp-dir\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:30.969706 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.969205    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-home\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:30.970187 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.970023    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 02 13:57:30.970187 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.970099    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 02 13:57:30.991106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:30.990393    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"]
Nov 02 13:57:31.072313 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.072264    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-home\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.072699 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.072666    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czfjl\" (UniqueName: \"kubernetes.io/projected/59c0dd7f-56f0-4fba-bc05-3d831ea90471-kube-api-access-czfjl\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.074215 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.074194    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-model-cache\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.074423 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.074406    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tls-certs\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.074557 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.074541    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-dshm\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.074704 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.074689    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tmp-dir\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.075452 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.075430    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tmp-dir\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.075683 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.074129    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-home\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.076200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.076181    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-model-cache\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.115900 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.115811    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czfjl\" (UniqueName: \"kubernetes.io/projected/59c0dd7f-56f0-4fba-bc05-3d831ea90471-kube-api-access-czfjl\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.118935 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.118904    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tls-certs\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.119593 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.119567    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-dshm\") pod \"distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") " pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.186567 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.186527    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:31.808428 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.803481    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" event={"ID":"f419c032-58c1-4b81-809d-25af9d31453e","Type":"ContainerStarted","Data":"2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5"}
Nov 02 13:57:31.849506 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:31.829186    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"]
Nov 02 13:57:32.055215 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.053844    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:32.071336 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.070410    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:32.076502 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.074129    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:32.078173 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.078145    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:32.099304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.099205    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 13:57:32.108098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.102766    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podStartSLOduration=4.102743596 podStartE2EDuration="4.102743596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:31.863669365 +0000 UTC m=+830.944814486" watchObservedRunningTime="2026-11-02 13:57:32.102743596 +0000 UTC m=+831.183888716"
Nov 02 13:57:32.528376 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.528270    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:32.529651 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.529627    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:32.619945 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.619911    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 13:57:32.941635 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.941591    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" event={"ID":"59c0dd7f-56f0-4fba-bc05-3d831ea90471","Type":"ContainerStarted","Data":"1f8eb2bfc10c38354b86c4a745e51679fc9bf1bf3a23e3e7046bab9fa149f06c"}
Nov 02 13:57:32.942330 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:32.942281    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" event={"ID":"59c0dd7f-56f0-4fba-bc05-3d831ea90471","Type":"ContainerStarted","Data":"5a89351ec89c20604d6a77cced1eed87bcf098dabca682e36d0ddd4c07459673"}
Nov 02 13:57:33.012208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:33.007192    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podStartSLOduration=3.00716841 podStartE2EDuration="3.00716841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:32.987699951 +0000 UTC m=+832.068845073" watchObservedRunningTime="2026-11-02 13:57:33.00716841 +0000 UTC m=+832.088313541"
Nov 02 13:57:33.256890 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:33.255878    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:33.419661 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:33.419598    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:34.420461 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:34.420424    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:35.501354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:35.501317    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:36.079900 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.079853    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"]
Nov 02 13:57:36.089702 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.089666    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.111368 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:57:36.109715    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:57:36.111368 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.109887    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9e0c2f\"/\"distinct-w4-9e0c2f-kserve-self-signed-certs\""
Nov 02 13:57:36.121341 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.121308    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"]
Nov 02 13:57:36.164993 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.164957    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:36.200951 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.200908    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-dshm\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.200951 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.200951    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-home\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.201264 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.201142    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-model-cache\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.201264 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.201210    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8hwc\" (UniqueName: \"kubernetes.io/projected/a105dea4-399c-49a9-aacc-72f443e80de2-kube-api-access-t8hwc\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.201379 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.201301    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a105dea4-399c-49a9-aacc-72f443e80de2-tls-certs\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.201439 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.201407    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-tmp-dir\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.302907 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.302853    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-dshm\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.303664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.303638    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-home\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.304002 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.303978    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-model-cache\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.304241 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.304223    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8hwc\" (UniqueName: \"kubernetes.io/projected/a105dea4-399c-49a9-aacc-72f443e80de2-kube-api-access-t8hwc\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.304408 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.304384    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a105dea4-399c-49a9-aacc-72f443e80de2-tls-certs\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.309592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.305163    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-model-cache\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.309592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.305456    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-home\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.309592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.309285    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-tmp-dir\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.309592 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.309558    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-tmp-dir\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.310916 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.310875    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a105dea4-399c-49a9-aacc-72f443e80de2-tls-certs\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.313423 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.313392    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-dshm\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.321491 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.321404    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8hwc\" (UniqueName: \"kubernetes.io/projected/a105dea4-399c-49a9-aacc-72f443e80de2-kube-api-access-t8hwc\") pod \"distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") " pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.408774 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.408648    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:36.719431 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.719341    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:36.734871 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:57:36.734800    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda105dea4_399c_49a9_aacc_72f443e80de2.slice/crio-0254e5aefdf41f6639903c0898c679005fdf52f4fff4bb816f388f76bce16c81 WatchSource:0}: Error finding container 0254e5aefdf41f6639903c0898c679005fdf52f4fff4bb816f388f76bce16c81: Status 404 returned error can't find the container with id 0254e5aefdf41f6639903c0898c679005fdf52f4fff4bb816f388f76bce16c81
Nov 02 13:57:36.738147 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.738102    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"]
Nov 02 13:57:36.982086 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.981954    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" event={"ID":"a105dea4-399c-49a9-aacc-72f443e80de2","Type":"ContainerStarted","Data":"030e951976c0203cdeaf6f9b00d87e6197adca7897ffa69b85d8d0220a420b27"}
Nov 02 13:57:36.982086 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:36.982008    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" event={"ID":"a105dea4-399c-49a9-aacc-72f443e80de2","Type":"ContainerStarted","Data":"0254e5aefdf41f6639903c0898c679005fdf52f4fff4bb816f388f76bce16c81"}
Nov 02 13:57:37.005744 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:37.005679    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podStartSLOduration=1.005663564 podStartE2EDuration="1.005663564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:37.002765207 +0000 UTC m=+836.083910329" watchObservedRunningTime="2026-11-02 13:57:37.005663564 +0000 UTC m=+836.086808745"
Nov 02 13:57:37.409304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:37.409263    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:37.726174 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:37.724708    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:38.734055 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:38.734012    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:39.209390 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:39.209342    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:39.224805 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:39.224771    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:39.534599 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:39.534540    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:40.016617 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:40.016520    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:40.388922 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:40.388871    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:41.188032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:41.187985    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:41.203304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:41.203270    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:41.369621 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:41.369581    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:42.038577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:42.038543    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:42.354431 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:42.354338    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:43.161564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:43.161497    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:44.169233 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:44.169186    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:45.438692 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:45.438648    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:46.379777 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:46.379729    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:46.409375 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:46.409343    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:46.425254 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:46.425196    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:47.079798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:47.079769    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:47.448850 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:47.448730    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:48.367512 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:48.367471    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:49.542151 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:49.542113    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:50.650234 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.650189    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"]
Nov 02 13:57:50.657185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.657152    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.708250 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.708212    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"]
Nov 02 13:57:50.820315 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820277    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.820797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820333    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.820797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820550    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.820797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820619    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.820797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820657    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.820797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820682    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qc87\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-kube-api-access-9qc87\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.820797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820757    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.821387 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820819    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.821387 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.820884    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.921848 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.921668    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:50.934261 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.929257    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"]
Nov 02 13:57:50.935210 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.931263    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935305    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.931647    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935442    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935632 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935486    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935632 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935605    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935712 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935675    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935712 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935701    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935730    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qc87\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-kube-api-access-9qc87\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.935839 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.935820    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.936987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.936957    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.938127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.937587    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.938127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.937915    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.938295 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.938166    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.940203 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.940180    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.940322 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.940247    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.943578 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.942709    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:50.970767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.968173    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qc87\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-kube-api-access-9qc87\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.972022 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.971987    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:50.985817 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:50.985776    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"]
Nov 02 13:57:51.020410 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.012689    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"]
Nov 02 13:57:51.020410 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.016278    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:51.086096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.069987    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad735154-4a32-4029-b513-9e7fcd82be60-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.086096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.070042    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad735154-4a32-4029-b513-9e7fcd82be60-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.087106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.086569    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn6mx\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-kube-api-access-mn6mx\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.087106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.086646    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.087106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.086740    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.087106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.086771    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.087106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.086869    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.087106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.086922    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.087106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.086991    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.148358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.148319    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"]
Nov 02 13:57:51.195994 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.195306    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"]
Nov 02 13:57:51.199127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.198382    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.205126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.201137    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206205    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn6mx\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-kube-api-access-mn6mx\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206264    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206331    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206358    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206424    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206466    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206516    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206602    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad735154-4a32-4029-b513-9e7fcd82be60-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.207366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.206626    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad735154-4a32-4029-b513-9e7fcd82be60-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.209519 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.208042    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad735154-4a32-4029-b513-9e7fcd82be60-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.211974 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.210607    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.211974 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.211146    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.211974 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.211401    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.211974 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.211619    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.215756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.214192    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.249891 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.247530    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.255929 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.255886    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"]
Nov 02 13:57:51.256983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.256963    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"]
Nov 02 13:57:51.258052 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.256879    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad735154-4a32-4029-b513-9e7fcd82be60-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.261669 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.261608    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn6mx\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-kube-api-access-mn6mx\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.275820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.268582    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"]
Nov 02 13:57:51.275820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.275369    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.278496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.278468    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.278869 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.278317    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"]
Nov 02 13:57:51.314672 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.314628    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.314985 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.314957    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"]
Nov 02 13:57:51.315262 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.314963    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.315373 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315311    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.315373 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315350    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.315500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315377    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.315500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315418    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.315500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315474    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.315667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315498    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.315667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315526    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.315667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315550    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.315667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315596    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33967ffd-9513-4320-9979-d9b362980e39-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.315667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315641    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.315667 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315664    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315721    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315758    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315796    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315818    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315840    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315865    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315896    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315928    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33967ffd-9513-4320-9979-d9b362980e39-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.315987    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.316013    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.316126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.316052    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.330222 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.316129    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.330534 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.330503    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.330696 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.330677    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.330820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.330804    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.330939 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.330922    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0361eb54-8d3a-4522-8d65-176c37a4aa24-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.331056 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.331041    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.331215 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.331197    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4clb2\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-kube-api-access-4clb2\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.331370 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.331354    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664674d2-5544-48f2-a75e-6dd5e48ea244-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.331512 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.331484    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw2lw\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-kube-api-access-hw2lw\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.331630 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.331614    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mqj6\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-kube-api-access-2mqj6\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.331752 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.331738    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blrjp\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-kube-api-access-blrjp\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.331868 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.331853    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119b10e2-6c1b-42de-a168-8348caafd4d6-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.450148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.441399    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456053    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456137    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456177    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456203    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456224    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456245    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456274    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456300    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33967ffd-9513-4320-9979-d9b362980e39-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456351    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456374    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456411    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456435    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456473    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456499    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456528    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456618    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0361eb54-8d3a-4522-8d65-176c37a4aa24-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456652    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456679    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4clb2\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-kube-api-access-4clb2\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456740    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664674d2-5544-48f2-a75e-6dd5e48ea244-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456776    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw2lw\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-kube-api-access-hw2lw\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456808    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mqj6\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-kube-api-access-2mqj6\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456850    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blrjp\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-kube-api-access-blrjp\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.456877    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119b10e2-6c1b-42de-a168-8348caafd4d6-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457006    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457031    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457101    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457128    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457154    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457198    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457265    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457292    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457321    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457346    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457411    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33967ffd-9513-4320-9979-d9b362980e39-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457476    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.457502    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.462474    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.480335    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664674d2-5544-48f2-a75e-6dd5e48ea244-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.481894    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119b10e2-6c1b-42de-a168-8348caafd4d6-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.482280    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.483097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.482771    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.490661    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.496554    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.496983    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.515689    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.516822    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.516905    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.517964    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33967ffd-9513-4320-9979-d9b362980e39-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.518289    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.527009 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.523843    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.541802 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.529687    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.562968 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.562896    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.565514 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.565474    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.566418 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.566383    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.566523 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.566429    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.566692 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.566664    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.578671 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.566901    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.578671 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.567147    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.578671 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.567412    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.578671 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.571744    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0361eb54-8d3a-4522-8d65-176c37a4aa24-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.612116 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.589726    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.612116 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.602422    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.614619 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.614540    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blrjp\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-kube-api-access-blrjp\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.619358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.615046    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33967ffd-9513-4320-9979-d9b362980e39-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.619358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.615499    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw2lw\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-kube-api-access-hw2lw\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.619358 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.615785    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mqj6\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-kube-api-access-2mqj6\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.632581 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.631524    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.632581 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.632483    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4clb2\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-kube-api-access-4clb2\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.632907 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.632786    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.664238 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.649552    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:51.664238 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.656792    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.664238 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.657435    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:51.708355 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.693617    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:51.848141 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.846599    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:51.859804 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:51.859767    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:52.110809 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.110613    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:52.115892 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.114843    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"]
Nov 02 13:57:52.248296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.247568    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:52.248296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.247676    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:52.248296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.247728    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:52.310815 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.310759    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" event={"ID":"5e21fcdd-669d-46d7-8233-35e037dfb1fb","Type":"ContainerStarted","Data":"507ae816f6ea955f07c84efb1d2bd91066cf29063819405d84344cd8a26dee2e"}
Nov 02 13:57:52.360192 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.360101    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:52.862242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:52.849904    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"]
Nov 02 13:57:53.049690 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.034289    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:53.371199 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.371151    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.371501 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.371475    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.371650 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.371631    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.373637 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.373610    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"]
Nov 02 13:57:53.537412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.536938    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" event={"ID":"119b10e2-6c1b-42de-a168-8348caafd4d6","Type":"ContainerStarted","Data":"fe7a7ed8a97eab96423b9771ef3ca896ce447d06e40a2dcb6064e8b43e6cca5e"}
Nov 02 13:57:53.540718 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.540633    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" event={"ID":"ad735154-4a32-4029-b513-9e7fcd82be60","Type":"ContainerStarted","Data":"380e90c2476c4a60cc65d01add982ad87815ffa6fc97fd7368926d782445abe0"}
Nov 02 13:57:53.570231 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.569877    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.584216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.581618    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.584216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.581720    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.800159 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.799873    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:53.841913 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.834443    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"]
Nov 02 13:57:53.842139 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.841930    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:57:53.874208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.844790    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:53.874208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.848932    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.874208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.849036    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.874208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.851831    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:53.874208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.867269    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:53.906791 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.906750    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:53.947430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.946627    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:53.948520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:53.948192    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:54.060861 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.060244    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:54.084496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.084450    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:57:54.290328 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.288158    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"]
Nov 02 13:57:54.489176 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.425618    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:57:54.611096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.609862    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"]
Nov 02 13:57:54.757276 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.685618    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:54.757276 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.685727    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:54.757276 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.685776    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:54.760321 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.760287    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:54.824247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.813447    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:54.824247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.813549    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:54.824247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.813592    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:57:54.824247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.814882    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" event={"ID":"0361eb54-8d3a-4522-8d65-176c37a4aa24","Type":"ContainerStarted","Data":"d95556f9750d51d5cd69d0f951274d1e31ecc6481f9ee021c15f142d1bc8f7f3"}
Nov 02 13:57:54.824247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.816876    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" event={"ID":"33967ffd-9513-4320-9979-d9b362980e39","Type":"ContainerStarted","Data":"41b61a3de957082d851a20a89cebfa7e7f33033c441084937db9615d41000620"}
Nov 02 13:57:54.824247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.819441    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" event={"ID":"5e21fcdd-669d-46d7-8233-35e037dfb1fb","Type":"ContainerStarted","Data":"5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb"}
Nov 02 13:57:54.852094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.842231    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:54.852094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.843097    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:57:54.917172 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.917123    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:57:55.034456 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:54.965724    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:55.105041 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.001482    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:57:55.106771 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.034708    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:55.107302 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.061220    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:55.112754 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.112692    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podStartSLOduration=5.112671392 podStartE2EDuration="5.112671392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:54.92047552 +0000 UTC m=+854.001620642" watchObservedRunningTime="2026-11-02 13:57:55.112671392 +0000 UTC m=+854.193816514"
Nov 02 13:57:55.174723 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.174683    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:57:55.205383 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.205339    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:57:55.233987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.233952    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:57:55.241446 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.241418    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:55.243222 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.243195    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:57:55.244291 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.244270    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:57:55.244572 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.244558    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:55.245573 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.245555    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:57:55.419573 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.419106    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:57:55.441739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.435130    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:57:55.441739 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.438253    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:57:55.531106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.530569    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:57:55.549562 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.533302    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:55.685385 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.685352    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:55.762510 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.762465    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:55.782926 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.776818    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:55.898241 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.894693    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" event={"ID":"664674d2-5544-48f2-a75e-6dd5e48ea244","Type":"ContainerStarted","Data":"451e6b1f0d37297959fa180f437cef070992dc1fdbc7ba5ee8af5b344cfd5248"}
Nov 02 13:57:55.980098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:55.976859    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" event={"ID":"119b10e2-6c1b-42de-a168-8348caafd4d6","Type":"ContainerStarted","Data":"a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0"}
Nov 02 13:57:56.058891 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.050165    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podStartSLOduration=5.050139578 podStartE2EDuration="5.050139578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:56.025942555 +0000 UTC m=+855.107087679" watchObservedRunningTime="2026-11-02 13:57:56.050139578 +0000 UTC m=+855.131284823"
Nov 02 13:57:56.059938 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.059886    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:57:56.087647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.087612    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:57:56.088287 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.087356    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" event={"ID":"ad735154-4a32-4029-b513-9e7fcd82be60","Type":"ContainerStarted","Data":"e375e269703b4f7a73253013e585dfff4e4562a2f9576b52bf67da6908e341a6"}
Nov 02 13:57:56.214159 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.194125    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podStartSLOduration=6.194097897 podStartE2EDuration="6.194097897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:56.185976058 +0000 UTC m=+855.267121185" watchObservedRunningTime="2026-11-02 13:57:56.194097897 +0000 UTC m=+855.275243019"
Nov 02 13:57:56.305155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.297219    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" event={"ID":"0361eb54-8d3a-4522-8d65-176c37a4aa24","Type":"ContainerStarted","Data":"3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463"}
Nov 02 13:57:56.422084 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.422001    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podStartSLOduration=5.421977483 podStartE2EDuration="5.421977483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:56.400848243 +0000 UTC m=+855.481993364" watchObservedRunningTime="2026-11-02 13:57:56.421977483 +0000 UTC m=+855.503122606"
Nov 02 13:57:56.513482 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.460191    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" event={"ID":"33967ffd-9513-4320-9979-d9b362980e39","Type":"ContainerStarted","Data":"c696ef4e0cc46d26e4376b692ce20a2622f9915d7af74fb49d5b78dfcb605062"}
Nov 02 13:57:56.517095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.513785    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:57:56.522280 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.512876    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:57:56.522588 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.522557    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:57:56.553131 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.553042    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podStartSLOduration=6.553019802 podStartE2EDuration="6.553019802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:56.543712684 +0000 UTC m=+855.624857810" watchObservedRunningTime="2026-11-02 13:57:56.553019802 +0000 UTC m=+855.634164923"
Nov 02 13:57:56.659014 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.658965    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:57:56.661018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.660963    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:57:56.661337 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.661285    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:57:56.688940 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.688858    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:56.765840 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.763874    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:56.786103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.786027    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:56.799092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.786626    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:57:56.841340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.841292    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:56.842141 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.842117    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:57:56.903095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.871416    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:57:56.903488 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.872808    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:57:56.903679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.903645    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:57:56.936234 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:56.936179    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:57:57.051161 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.039732    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:57.291296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.291255    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:57:57.291585 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.291553    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:57:57.291819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.291802    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:57:57.291959 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.291938    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:57:57.321289 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.321171    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:57.443097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.418449    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:57.709937 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.443728    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:57:57.909128 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.604369    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:57:57.909128 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.707235    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:57:57.909980 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.707350    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/health\": context deadline exceeded"
Nov 02 13:57:57.910196 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.910172    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:57.910880 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.725243    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:57:57.910993 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.910939    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:57:57.911508 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.786043    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:57.912295 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.842441    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:57.913513 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.756209    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:57:58.038245 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.038185    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:57:58.038479 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.029444    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.038638 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.952448    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.038909 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:57.855711    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:57:58.038997 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.038943    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:57:58.038997 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.029576    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:57:58.039185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.039010    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:57:58.039185 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.039172    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:57:58.058097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.051343    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.092097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.071543    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.092097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.072105    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:58.203553 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.203485    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.297653 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.297476    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:57:58.323244 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.323169    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.324038 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.324013    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:57:58.441099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.420671    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.489857 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.489814    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:57:58.490201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.490164    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:57:58.518628 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.518593    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:57:58.518928 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.518898    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:57:58.608593 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.608467    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.692274 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.691481    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:57:58.692274 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.691553    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:57:58.729101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.707893    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" event={"ID":"664674d2-5544-48f2-a75e-6dd5e48ea244","Type":"ContainerStarted","Data":"7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848"}
Nov 02 13:57:58.769322 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.769261    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:58.930566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.930456    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.204184 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:58.951340    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:57:59.233585 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.038748    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.234181 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.038786    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:57:59.234786 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.038808    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:57:59.234786 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.053060    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:57:59.237102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.053174    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:57:59.256983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.053244    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.259450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.089536    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:57:59.259764 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.259714    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:57:59.259920 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.093819    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:57:59.264500 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.053272    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:57:59.285215 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.093780    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": context deadline exceeded"
Nov 02 13:57:59.311758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.154248    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:57:59.312094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.312022    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:57:59.313103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.125057    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:57:59.313299 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.313272    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:57:59.313422 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.237291    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:57:59.313559 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.203958    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.326111 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.325180    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.434357 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.434299    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.467239 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.467138    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:57:59.467570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.467552    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:57:59.467756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.467743    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:57:59.467875 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.467865    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:57:59.467995 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.467985    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:57:59.472208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.472132    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:57:59.472208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.472205    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:57:59.507361 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.507326    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:57:59.507662 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.507646    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:57:59.632716 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.609847    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.632716 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.628578    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:57:59.702265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.702183    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:57:59.702606 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.702557    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:57:59.911099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.910530    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:57:59.956148 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.817255    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:57:59.960550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.960517    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:57:59.987515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:57:59.987478    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.009525 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.009477    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:00.010426 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.004848    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.114160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.114111    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:00.145216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.054174    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:00.145501 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.116516    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.145602 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.040720    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.145758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.145730    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:00.146526 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.038708    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podStartSLOduration=10.038684335 podStartE2EDuration="10.038684335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:59.022149892 +0000 UTC m=+858.103295019" watchObservedRunningTime="2026-11-02 13:58:00.038684335 +0000 UTC m=+859.119829457"
Nov 02 13:58:00.153291 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.153229    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:00.173188 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.146254    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:00.341196 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.314319    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:58:00.342220 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.314361    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:00.342448 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.316062    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:00.342563 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.316118    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:58:00.380141 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.371170    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:00.380141 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.375401    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:00.471330 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.471197    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:00.492221 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.473848    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.493040 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.492997    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:00.634097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.625171    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:00.695094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.695040    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.695278 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.695124    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:00.865109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.864489    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.865109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.864545    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:00.865109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.864808    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:00.865109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:00.864839    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:01.033098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.017986    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:01.070096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.066194    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:58:01.114381 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.114340    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:01.114936 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.114788    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.135515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.135417    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:01.233835 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.233790    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:01.311158 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.018050    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:01.319108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.317177    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.357127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.349946    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:58:01.357127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.350093    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.357127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.350155    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:58:01.357127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.350203    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:58:01.390320 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.390205    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.390602 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.390579    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:58:01.496189 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.496148    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.520179 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.520138    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.521562 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.521530    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:01.547249 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.547195    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:01.547560 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.523003    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.646169 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.638493    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:01.646169 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.638593    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:01.900254 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.897325    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:01.900254 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.897396    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:01.900254 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.898142    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:01.900254 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.898191    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:01.926731 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.924193    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:01.926731 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:01.924261    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:02.022885 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.022837    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:02.023145 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.022905    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:02.069103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.067671    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:58:02.122097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.119741    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:02.122097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.119820    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:02.143147 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.140947    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.143147 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.141531    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:02.200219 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.199676    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.479844 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.479745    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:02.480457 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.480420    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:02.508277 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.508216    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.513302 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.513236    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.539245    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.539860    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.540222    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.540547    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.540822    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.541147    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.541545    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.550564    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.551014    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.551444    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:58:02.568099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.551531    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:02.678142 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.668298    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:02.716529 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.716472    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:02.719415 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.719381    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:02.719661 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.719619    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:02.939267 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.916672    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:02.940848 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.940795    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:02.941270 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.921587    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:02.941454 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:02.941430    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:03.104282 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.104227    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:03.125374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.125310    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:58:03.216671 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.216562    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:03.235051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.218050    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:03.235439 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.235388    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:03.263613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.263564    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:03.294293 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.294250    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:03.294757 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.294570    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:03.557701 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.557666    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:03.567575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.567529    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:03.569606 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.569561    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:03.696101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.604842    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:03.696101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.651567    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:03.696398 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.696186    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:03.719103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.713590    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:58:03.723356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.723284    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:03.723722 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.723659    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:03.724191 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.724156    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:58:03.951175 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.739328    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:58:04.000093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.977983    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.082018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.080312    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.082018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.080379    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:04.082018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.739371    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:58:04.082018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.762150    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:04.094102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.035604    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:58:04.094102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.088727    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:58:04.094102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.088770    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:04.094102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.088810    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:04.117155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:03.761099    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/health\": context deadline exceeded"
Nov 02 13:58:04.117155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.106265    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:04.117155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.036889    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:04.117155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.113580    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.117155 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.113635    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:04.151097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.125659    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.220724 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.183788    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:04.233375 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.220592    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:04.460905 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.460858    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.461258 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.461214    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:04.610574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.610535    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:04.656405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.656351    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.656703 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.656670    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:04.695201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.695150    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:04.750123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.712226    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:04.750123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.713484    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:58:04.750123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.713885    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:58:04.750123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.718781    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:04.765325 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.765281    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:04.826541 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.826395    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:04.882234 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.882129    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.882550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.882500    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:04.906229 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.906175    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/health\": context deadline exceeded"
Nov 02 13:58:04.931614 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.931580    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:04.935754 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.935434    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:04.961672 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:04.956142    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.103551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.103477    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.104470 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.104426    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/health\": context deadline exceeded"
Nov 02 13:58:05.187209 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.161547    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:58:05.270688 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.270644    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.275263 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.275224    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:05.275560 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.275531    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:05.283213 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.283159    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.322758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.322430    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:05.323156 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.323123    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:05.383223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.383155    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:58:05.589948 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.589895    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:05.642495 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.642426    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:05.722221 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.722173    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.730105 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.725490    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:58:05.790243 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.767318    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:05.790243 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.767387    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:05.849313 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.798475    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.849744 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.849697    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.877227 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.877171    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:58:05.923291 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.880626    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:05.988222 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.882202    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:05.988556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:05.988524    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:58:06.012570 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.012531    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:06.012901 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.012882    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:58:06.054097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.045250    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:58:06.054097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.016156    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:06.054097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.046386    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:06.054516 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.025286    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:06.059102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.055153    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:06.064688 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.042558    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:06.099211 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.099153    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:06.104478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.104372    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:06.129819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.129778    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:06.131288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.131249    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:06.233451 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.233406    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:06.278138 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.273164    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:06.308241 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.308182    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:06.309000 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.308974    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:06.452161 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.436871    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:58:06.651247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.638645    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:06.651247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.638730    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:06.651247 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.642789    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:58:06.722290 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:58:06.707989    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:58:07.299198 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.755716    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.299901 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.808219    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.302254 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.842146    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:58:07.335100 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.907846    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.340178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.340136    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:07.340438 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.092893    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.341454 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.069933    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:58:07.349348 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.939238    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.349348 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.343161    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:07.349348 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.112803    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:07.350966 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.112726    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:58:07.352533 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.264359    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.353452 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.274323    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.363134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:06.943651    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.363134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.361243    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:07.363134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.131392    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:58:07.363486 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.112692    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:58:07.364096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.324316    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.374104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.112763    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:58:07.379252 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.131258    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.379576 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.379525    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 02 13:58:07.379737 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.132483    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.379849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.379831    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:07.419128 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.419094    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:58:07.419466 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.419453    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:58:07.420340 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.420323    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:58:07.425288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.425261    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:58:07.442304 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.440578    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.489532 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.488831    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:07.505548 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.505417    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:07.522672 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.508533    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.523044 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.523005    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:07.657140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.657017    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.657741 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.657707    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:07.771587 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.771553    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:07.859567 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.859526    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.860533 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.860493    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:07.861034 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.861009    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:07.861230 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.861206    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:07.881779 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:07.881738    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.116716 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.116678    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:08.117005 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.116976    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:08.241587 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.241550    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:08.305374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.302281    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:58:08.305374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.302726    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:58:08.332795 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.331566    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:08.353095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.341192    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.353095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.342350    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.353879 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.353835    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.362913 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.362869    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.363578 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.363548    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:58:08.364016 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.363995    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:58:08.365134 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.365105    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.377649 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.377520    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.432268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.419157    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:08.509097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.477520    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:58:08.509889 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.509857    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:08.510130 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.510096    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:08.690157 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.653752    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:08.690157 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.667251    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:08.732926 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.732895    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:58:08.884101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.876372    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:08.884101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.876451    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:08.910199 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.910158    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:08.910522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:08.910489    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:09.019873 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.019771    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:58:09.019873 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.019838    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.020287 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.020232    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.174905 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.170295    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:09.174905 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.170357    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:09.259261 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.259232    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:58:09.279752 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.279718    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 13:58:09.307283 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.307223    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.344097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.343956    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.345801 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.344679    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:58:09.369490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.365447    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.369490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.366787    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.369490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.367138    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.369490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.367422    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.369490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.367672    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.387971 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.387928    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.477724 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.456961    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:09.477724 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.457027    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:09.533152 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.527175    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.657729 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.657679    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 02 13:58:09.657952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.657750    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 02 13:58:09.764256 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.764193    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:58:09.769119 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.768531    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:58:09.780111 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.776981    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:09.855987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.855880    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:09.856296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.856251    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:09.875366 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.875332    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:09.875647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:09.875617    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:10.102928 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.102867    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.124129 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.123998    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 02 13:58:10.124432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.124384    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 02 13:58:10.198202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.198119    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:10.311581 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.311532    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.333848 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.330614    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:10.364870 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.364817    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.366423 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.366372    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.369216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.369161    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.369849 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.369817    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.370814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.370034    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:58:10.370814 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.370087    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:58:10.394101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.393946    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.530374 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.530320    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:10.530717 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.530668    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:10.531327 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.531272    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.777171 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.776684    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.793108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.777862    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.793108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.778104    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:58:10.793108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.778457    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:10.874097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.855232    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:10.878097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.875499    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:10.901311 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.895817    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 02 13:58:10.911587 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.910204    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 02 13:58:10.960632 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.960595    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 02 13:58:10.961038 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:10.961005    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 02 13:58:11.338767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.338720    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:11.411836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.385209    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:58:11.417524 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.385255    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:58:11.434284 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.385325    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:11.435359 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.385685    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:11.446111 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.385727    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:58:11.446111 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.385747    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:58:11.446111 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.407297    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:58:11.475096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.468083    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 02 13:58:11.549647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.502734    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 02 13:58:11.552558 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.552141    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:11.571647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.571613    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:58:11.736201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.729274    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:11.736201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.729325    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:58:11.736201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.729359    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:58:11.736201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.729388    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:58:11.736201 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.675333    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/health\": context deadline exceeded"
Nov 02 13:58:11.783118 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.741531    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:58:11.785691 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.785654    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:58:11.786011 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.785958    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:11.792110 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.787596    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:58:11.863096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.858481    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:58:11.891037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.863881    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:58:11.891037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.865883    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 13:58:11.891037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:11.866380    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:12.168282 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.168228    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:58:12.168604 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.168562    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:12.254127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.254095    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:58:12.259504 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.259455    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:12.304770 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.300361    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:58:12.323100 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.318252    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 13:58:12.431162 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.424539    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:12.450760 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.435918    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:12.672203 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.672151    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:12.758276 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.758181    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:58:12.823424 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.823395    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:58:12.860795 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.860765    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:12.881002 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.880965    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:58:12.882999 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.882944    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:12.955251 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.955206    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:58:12.955542 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:12.955516    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:13.023825 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.022443    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:58:13.030121 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.030060    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 13:58:13.261255 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.256458    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:58:13.275664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.275571    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 13:58:13.354894 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.354482    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:58:13.356808 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.356767    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:13.371100 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.366761    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 13:58:13.902756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:13.902713    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:14.827037 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:14.826356    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:15.590556 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.590512    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"]
Nov 02 13:58:15.597208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.597173    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.617805 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.617777    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7a9443\"/\"distinct-2-w0-7a9443-kserve-self-signed-certs\""
Nov 02 13:58:15.626603 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.626562    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"]
Nov 02 13:58:15.667858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.662966    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-home\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.667858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.663156    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-dshm\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.667858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.663190    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jfzf\" (UniqueName: \"kubernetes.io/projected/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-kube-api-access-4jfzf\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.667858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.663228    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-model-cache\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.667858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.663336    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tmp-dir\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.667858 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.663376    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tls-certs\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.689493 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.689393    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:15.770885 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.770801    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tmp-dir\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.771229 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.771208    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tls-certs\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.771521 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.771499    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-home\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.771784 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.771765    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-dshm\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.771914 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.771899    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jfzf\" (UniqueName: \"kubernetes.io/projected/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-kube-api-access-4jfzf\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.772027 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.772012    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-model-cache\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.772691 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.772669    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-model-cache\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.773092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.773044    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tmp-dir\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.775268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.775239    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-home\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.776774 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.776744    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-dshm\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.777530 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.777506    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tls-certs\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.789352 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.789317    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jfzf\" (UniqueName: \"kubernetes.io/projected/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-kube-api-access-4jfzf\") pod \"distinct-2-w0-7a9443-kserve-5948b57f86-77z56\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") " pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:15.960153 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:15.959937    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:16.312093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:16.311043    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:16.702922 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:16.701791    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"]
Nov 02 13:58:17.761816 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:17.761740    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" event={"ID":"3daa95f1-a1f8-4c2e-aab8-b2aee344b247","Type":"ContainerStarted","Data":"2eff0e27745d4190f864e24d18230a07a9f754677242b61c6537feb116dd7944"}
Nov 02 13:58:17.984239 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:17.984195    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:18.097927 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.097883    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:18.173221 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.173174    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:18.269490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.269446    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:18.347638 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.347589    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:58:18.349585 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.349491    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:18.357216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.357167    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:18.546234 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.546183    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:18.678455 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:18.678351    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:19.026175 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.025368    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:19.026669 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.026534    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:19.175239 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.175159    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:58:19.178101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.177703    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:58:19.227226 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.226501    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:19.359538 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.359467    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:19.383579 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.367247    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:19.406230 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.406188    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:58:19.457230 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.457156    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:19.500791 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.500759    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:19.554633 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.554590    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:19.555251 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.555230    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:58:19.585184 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.585151    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:58:19.690634 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.688892    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:58:19.735678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.734638    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:19.882299 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.882060    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" event={"ID":"3daa95f1-a1f8-4c2e-aab8-b2aee344b247","Type":"ContainerStarted","Data":"59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009"}
Nov 02 13:58:19.902225 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.902052    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podStartSLOduration=4.902035303 podStartE2EDuration="4.902035303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:58:19.901464043 +0000 UTC m=+878.982609167" watchObservedRunningTime="2026-11-02 13:58:19.902035303 +0000 UTC m=+878.983180422"
Nov 02 13:58:19.960971 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:19.960871    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:20.717600 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:20.717557    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:21.608018 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:21.607981    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:22.598482 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:22.598450    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:23.408385 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:23.408350    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:24.198560 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:24.198519    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:24.997496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:24.997464    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:25.701412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:25.701382    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:25.961305 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:25.961194    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:25.976299 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:25.976265    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:26.545691 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:26.545648    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:26.946372 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:26.946261    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:27.534006 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:27.533968    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:28.414229 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:28.410563    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:29.261540 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:29.261493    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:30.002218 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:30.002182    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:30.918192 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:30.918098    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:31.809377 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:31.809331    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:32.683124 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:32.683015    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:33.505394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:33.505356    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:34.295788 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:34.295754    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:35.327109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:35.327017    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:36.099131 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:58:36.099091    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:58:36.148783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.148747    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"]
Nov 02 13:58:36.154724 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.154694    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.189679 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.189639    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"]
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208379    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208502    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64b50361-73ce-4714-8eee-7852ab9d077f-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208565    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208597    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208668    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208693    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5lg6\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-kube-api-access-l5lg6\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208778    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208946    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.217685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.208995    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64b50361-73ce-4714-8eee-7852ab9d077f-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.303699 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.303365    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.319692    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.319798    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5lg6\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-kube-api-access-l5lg6\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.319906    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.320096    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.320151    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64b50361-73ce-4714-8eee-7852ab9d077f-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.320217    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.320335    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64b50361-73ce-4714-8eee-7852ab9d077f-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.320407    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.320436    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.320996    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.321577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.321272    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.327405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.324504    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64b50361-73ce-4714-8eee-7852ab9d077f-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.327405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.325316    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.327405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.325671    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.335775 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.332510    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.335775 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.333007    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64b50361-73ce-4714-8eee-7852ab9d077f-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.355767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.355453    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5lg6\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-kube-api-access-l5lg6\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.355767 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.355504    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.497866 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.497830    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:36.801758 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.801725    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"]
Nov 02 13:58:36.801889 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:58:36.801830    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b50361_73ce_4714_8eee_7852ab9d077f.slice/crio-2d5f7c682de91de6242ddfdcc122393e52c5ae0bd0b23ad09bbbd367b19a882e WatchSource:0}: Error finding container 2d5f7c682de91de6242ddfdcc122393e52c5ae0bd0b23ad09bbbd367b19a882e: Status 404 returned error can't find the container with id 2d5f7c682de91de6242ddfdcc122393e52c5ae0bd0b23ad09bbbd367b19a882e
Nov 02 13:58:36.804952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.804908    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:58:36.805081 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.805001    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:58:36.805081 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:36.805043    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:58:37.015777 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:37.015734    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" event={"ID":"64b50361-73ce-4714-8eee-7852ab9d077f","Type":"ContainerStarted","Data":"caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd"}
Nov 02 13:58:37.015993 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:37.015806    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" event={"ID":"64b50361-73ce-4714-8eee-7852ab9d077f","Type":"ContainerStarted","Data":"2d5f7c682de91de6242ddfdcc122393e52c5ae0bd0b23ad09bbbd367b19a882e"}
Nov 02 13:58:37.348090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:37.346257    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:37.498821 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:37.498783    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:37.500740 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:37.500701    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Nov 02 13:58:37.500866 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:37.500756    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Nov 02 13:58:38.317394 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:38.317357    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:38.499108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:38.499052    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Nov 02 13:58:38.499554 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:38.499141    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Nov 02 13:58:39.277881 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:39.277842    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:39.498810 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:39.498774    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Nov 02 13:58:39.499014 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:39.498844    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Nov 02 13:58:40.190575 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:40.190500    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:40.499038 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:40.498948    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Nov 02 13:58:40.499038 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:40.499015    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Nov 02 13:58:41.211639 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:41.211593    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:41.498701 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:41.498613    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Nov 02 13:58:41.498701 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:41.498670    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Nov 02 13:58:42.237108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:42.236511    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:42.499405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:42.499319    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Nov 02 13:58:42.499405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:42.499374    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Nov 02 13:58:43.353354 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:43.353315    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:43.498345 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:43.498309    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Nov 02 13:58:43.498526 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:43.498378    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Nov 02 13:58:44.604188 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:44.604154    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:45.093527 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:45.093491    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:45.094591 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:45.094562    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:45.100515 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:45.100487    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 13:58:45.170459 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:45.170395    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podStartSLOduration=9.170375001 podStartE2EDuration="9.170375001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:58:37.044181389 +0000 UTC m=+896.125326511" watchObservedRunningTime="2026-11-02 13:58:45.170375001 +0000 UTC m=+904.251520121"
Nov 02 13:58:46.040046 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:46.040008    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:47.709349 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:47.709293    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.121101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.106703    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.320200 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.307170    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.324099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.320905    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:58:48.399214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.346223    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.399214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.346351    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:58:48.414113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.405164    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.414113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.406060    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.472096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.446809    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.515098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.512262    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.599618 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.599568    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.614356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.614216    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:58:48.614356 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.614282    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.730171 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.729450    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.730672 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.730148    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.770099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.731275    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:58:48.770099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.754993    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:48.891829 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.891776    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:48.990221 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:48.962404    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.393453 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.393398    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.406395 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.406335    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.408312 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.408285    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:58:49.420113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.420054    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:58:49.459208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.459163    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.476142 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.472719    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:58:49.502160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.459164    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.502160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.490160    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.502160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.499619    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:49.502160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.499699    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:49.535815 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.504244    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.535815 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.504533    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:58:49.561252 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.536236    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.561252 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.536580    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:49.616359 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.606053    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.618051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.616849    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:58:49.748120 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.747991    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:58:49.866927 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.783013    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.907315 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.783060    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:49.929086 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.915306    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:58:49.968551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.935448    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:58:50.032162 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.993171    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.032162 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:49.993951    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:58:50.131098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.110340    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.395550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.394198    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.430108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.406786    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.430108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.407491    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.461228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.461172    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.496442 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.496393    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.523101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.497811    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.525433 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.508910    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.525433 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.508972    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:58:50.539028 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.538196    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.618101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.614655    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.875096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.868171    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.940097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.939212    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:50.940097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.939673    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:58:50.997290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:50.997214    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.021981 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.021949    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:58:51.413095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.410811    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:58:51.441342 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.437101    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:58:51.441342 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.439026    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.498166 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.492537    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:58:51.525099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.504540    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.548099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.525862    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:58:51.755214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.552691    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:58:51.755214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.556273    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": context deadline exceeded"
Nov 02 13:58:51.755214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.737052    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:51.755214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.556758    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.755214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.625628    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.755214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.647559    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.929109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.928738    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.950818 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.944605    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:51.950818 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.945051    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:58:51.998262 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:51.998201    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.072093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.046974    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.232991 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.232265    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.419202 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.419092    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.532099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.521961    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.565096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.533664    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.565096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.550700    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:58:52.678789 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.678575    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/health\": context deadline exceeded"
Nov 02 13:58:52.682914 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.682879    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:52.746770 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.735486    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.749150 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.744312    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:58:52.749815 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.744451    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": context deadline exceeded"
Nov 02 13:58:52.750285 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.744605    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": context deadline exceeded"
Nov 02 13:58:52.750692 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.746188    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.939811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.939706    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.951628 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.951564    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:52.952345 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:52.952307    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:58:53.006110 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.004313    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.051054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.051009    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.072725 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.072665    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.124234 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.124174    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:58:53.126582 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.126548    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:58:53.420437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.420210    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:58:53.425687 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.423456    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:58:53.523232 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.523179    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.545460 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.545421    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:58:53.564818 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.564408    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.696397 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.687495    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.751627    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.752309    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.752571    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.752644    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.752882    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": context deadline exceeded"
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.753135    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": context deadline exceeded"
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.756182    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:58:53.778099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.775043    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:58:53.824416 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.824370    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.946686 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.946586    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.961205 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.953206    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:58:53.985430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.972229    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:53.985430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:53.972603    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:58:54.037839 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.020091    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:58:54.064399 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.063231    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:58:54.067594 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.067564    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:58:54.079388 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.079355    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:58:54.114967 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.114930    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:58:54.116812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.116785    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:58:54.117963 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.117941    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:58:54.118194 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.118174    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:58:54.119534 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:54.119509    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:58:55.513801 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:55.513761    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:56.495052 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:56.495003    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:57.712469 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:57.712427    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:58.674313 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:58.674266    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:58:59.335263 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:58:59.335227    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:00.293486 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:00.293447    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:01.699721 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:01.699683    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:02.760429 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:02.760322    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:03.639726 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:03.639682    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:04.227702 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:04.227653    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"]
Nov 02 13:59:04.246523 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:04.246483    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"]
Nov 02 13:59:04.377493 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:04.377459    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:04.808860 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:04.808822    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:05.686030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.685979    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"]
Nov 02 13:59:05.691522 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.691494    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.718726 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.718683    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"]
Nov 02 13:59:05.739338 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.735699    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:05.812764 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.812720    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42eabaf-2e91-43c8-becc-96fece2cc472-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.812990 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.812782    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm79x\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-kube-api-access-rm79x\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.812990 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.812813    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.812990 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.812952    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.813223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.812996    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.813223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.813115    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.813223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.813209    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.813371 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.813344    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.813505 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.813486    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.914820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.914782    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42eabaf-2e91-43c8-becc-96fece2cc472-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.914839    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm79x\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-kube-api-access-rm79x\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.914870    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.914912    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.914936    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.914957    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915054 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915026    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915401 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915129    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915463 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915401    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915519 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915474    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915519 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915506    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915627 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915562    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915627 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915582    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.915731 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.915695    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42eabaf-2e91-43c8-becc-96fece2cc472-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.917832 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.917804    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.917951 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.917864    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.946355 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.944774    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.946355 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.944893    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm79x\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-kube-api-access-rm79x\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:05.959176 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.959136    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"]
Nov 02 13:59:05.967566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.967527    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:05.979504 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:05.979470    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"]
Nov 02 13:59:06.011506 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.011471    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:06.017999 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.017804    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e3bd29-f4ca-4411-8353-d618299080b3-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.017999 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.017934    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.017999 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.018001    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e3bd29-f4ca-4411-8353-d618299080b3-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.018412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.018059    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.018412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.018099    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.018412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.018158    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.018412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.018207    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnv9\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-kube-api-access-dhnv9\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.018412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.018237    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.018412 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.018253    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.094485 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:59:06.094441    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.127942    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128030    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnv9\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-kube-api-access-dhnv9\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128086    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128110    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128284    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e3bd29-f4ca-4411-8353-d618299080b3-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128358    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128396    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e3bd29-f4ca-4411-8353-d618299080b3-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128451    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.128478    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.129001    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.129418    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.130532    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e3bd29-f4ca-4411-8353-d618299080b3-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.131658 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.130758    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.133818 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.133758    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e3bd29-f4ca-4411-8353-d618299080b3-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.134019 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.133980    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.135642 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.135603    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.142564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.142196    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnv9\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-kube-api-access-dhnv9\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.153211 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.153139    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.293334 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.293303    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:06.338261 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.337772    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"]
Nov 02 13:59:06.341916 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:59:06.341884    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42eabaf_2e91_43c8_becc_96fece2cc472.slice/crio-dbe0a204a137859b20b4b5a5c7c4326ec531e3e44169f05f1b1b77e358362c13 WatchSource:0}: Error finding container dbe0a204a137859b20b4b5a5c7c4326ec531e3e44169f05f1b1b77e358362c13: Status 404 returned error can't find the container with id dbe0a204a137859b20b4b5a5c7c4326ec531e3e44169f05f1b1b77e358362c13
Nov 02 13:59:06.347154 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.345367    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:59:06.347154 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.345467    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:59:06.347154 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.345511    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:59:06.604634 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.604598    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"]
Nov 02 13:59:06.604839 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:59:06.604648    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e3bd29_f4ca_4411_8353_d618299080b3.slice/crio-c685d1fa6c5a345d75e908ab1b0b51a9981995a97f1ada91822c8ad0413a4702 WatchSource:0}: Error finding container c685d1fa6c5a345d75e908ab1b0b51a9981995a97f1ada91822c8ad0413a4702: Status 404 returned error can't find the container with id c685d1fa6c5a345d75e908ab1b0b51a9981995a97f1ada91822c8ad0413a4702
Nov 02 13:59:06.609550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.609504    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:59:06.609666 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.609608    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:59:06.609666 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.609655    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 13:59:06.990581 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:06.990471    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:07.272153 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.269133    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" event={"ID":"f42eabaf-2e91-43c8-becc-96fece2cc472","Type":"ContainerStarted","Data":"bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec"}
Nov 02 13:59:07.272153 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.269214    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" event={"ID":"f42eabaf-2e91-43c8-becc-96fece2cc472","Type":"ContainerStarted","Data":"dbe0a204a137859b20b4b5a5c7c4326ec531e3e44169f05f1b1b77e358362c13"}
Nov 02 13:59:07.280972 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.280923    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" event={"ID":"37e3bd29-f4ca-4411-8353-d618299080b3","Type":"ContainerStarted","Data":"f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9"}
Nov 02 13:59:07.281208 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.280998    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" event={"ID":"37e3bd29-f4ca-4411-8353-d618299080b3","Type":"ContainerStarted","Data":"c685d1fa6c5a345d75e908ab1b0b51a9981995a97f1ada91822c8ad0413a4702"}
Nov 02 13:59:07.294032 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.293995    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:07.296337 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.296301    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:07.296497 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.296362    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:07.297053 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.297007    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podStartSLOduration=2.296994137 podStartE2EDuration="2.296994137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:59:07.29590346 +0000 UTC m=+926.377048582" watchObservedRunningTime="2026-11-02 13:59:07.296994137 +0000 UTC m=+926.378139258"
Nov 02 13:59:07.323585 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:07.323512    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podStartSLOduration=2.32349619 podStartE2EDuration="2.32349619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:59:07.322403856 +0000 UTC m=+926.403548979" watchObservedRunningTime="2026-11-02 13:59:07.32349619 +0000 UTC m=+926.404641310"
Nov 02 13:59:08.018206 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:08.018160    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:08.020756 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:08.020721    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 02 13:59:08.020929 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:08.020782    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 02 13:59:08.277986 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:08.277892    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:08.307903 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:08.307402    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:08.307903 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:08.307465    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:09.014569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:09.012583    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 02 13:59:09.014569 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:09.012639    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 02 13:59:09.298647 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:09.298589    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:09.299309 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:09.299271    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:09.650890 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:09.650801    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:09.687922 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:09.687878    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"]
Nov 02 13:59:09.902143 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:09.877362    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:10.023098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:10.019105    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 02 13:59:10.023098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:10.019169    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 02 13:59:10.086096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:10.082167    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:10.362094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:10.355325    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:10.362094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:10.355396    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:11.015240 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:11.012014    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 02 13:59:11.015240 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:11.012119    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 02 13:59:11.301096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:11.299599    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:11.301096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:11.299666    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:11.377295 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:11.377259    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:12.012449 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:12.012416    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 02 13:59:12.012728 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:12.012698    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 02 13:59:12.305099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:12.304273    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:12.305099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:12.304352    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:12.372097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:12.368352    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:13.013278 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:13.013242    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 02 13:59:13.013811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:13.013782    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 02 13:59:13.302106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:13.300451    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:13.302106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:13.300520    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:13.779166 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:13.776818    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:14.012232 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:14.012197    5453 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 02 13:59:14.012450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:14.012254    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 02 13:59:14.293799 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:14.293753    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 02 13:59:14.294284 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:14.293841    5453 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 02 13:59:14.688678 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:14.688517    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" podUID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" containerName="payload-processing" containerID="cri-o://8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8" gracePeriod=25
Nov 02 13:59:14.809853 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:14.809810    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:15.122399 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:15.122366    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:15.125286 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:15.124668    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:15.126193 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:15.126169    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 13:59:15.628127 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:15.628056    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:15.628851 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:15.628827    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:15.630106 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:15.630081    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 13:59:15.862919 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:15.862785    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:16.616695 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:16.616581    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:17.239313 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:17.239278    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:17.385651 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:17.385612    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:18.174360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:18.174324    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:19.277601 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.277531    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" containerID="cri-o://8486d20820489c4cc35826d5773f9042734f9e8092fca6253bd11899cebbb0c0" gracePeriod=45
Nov 02 13:59:19.299511 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.299453    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" containerID="cri-o://1f8eb2bfc10c38354b86c4a745e51679fc9bf1bf3a23e3e7046bab9fa149f06c" gracePeriod=45
Nov 02 13:59:19.418140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.417090    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:59:19.434108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.431215    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:19.505311 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.505264    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:59:19.743747 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.743700    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:19.756217 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.756165    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:19.757499 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.757465    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:59:19.950428 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.950289    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:19.965725 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:19.965671    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.009721 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.009666    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.085305 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.085236    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.127530 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.127470    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.417501 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.417453    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.418525 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.418498    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:59:20.542098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.520354    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.546060 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.542522    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": context deadline exceeded"
Nov 02 13:59:20.546837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.546810    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:59:20.559520 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.547045    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:59:20.589167 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.547173    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.589167 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.547442    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Nov 02 13:59:20.589167 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.547484    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:59:20.763210 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.752342    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.782132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.763988    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.782132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.764282    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:59:20.950838 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.950786    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:20.968097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.951670    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:59:21.023321 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:20.968750    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:21.072322 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.035915    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:59:21.072322 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.039569    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:59:21.154091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.154026    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 02 13:59:21.441109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.429220    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:59:21.650093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.511846    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:21.675296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.525786    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Nov 02 13:59:21.811447 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.605452    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:21.834172 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.695279    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:59:21.847101 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.838311    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:59:21.847577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.847335    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:59:21.847577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.847416    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:59:21.847577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.847484    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:59:21.847577 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.847539    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:59:21.983421 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.983366    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.026110 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.985009    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.026625 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.026577    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.027172 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:21.994900    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.027559 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.027199    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.027761 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.027352    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:59:22.035223 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.035173    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.050091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.035658    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.092551 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.092429    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.094090 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.094030    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:59:22.126094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.125369    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:59:22.169096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.154722    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.182243 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.182199    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": dial tcp 10.133.0.53:8000: connect: connection refused"
Nov 02 13:59:22.445158 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.437235    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.496315 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.496264    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" podUID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 13:59:22.527135 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.527058    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Nov 02 13:59:22.563825 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.563665    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:59:22.695453 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.695350    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.842094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.832851    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:22.999489 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:22.999377    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.008109 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.007852    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.030098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.027184    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.030098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.028487    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.030098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.028823    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/health\": context deadline exceeded"
Nov 02 13:59:23.030098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.029501    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.030098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.029799    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:59:23.056490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.056446    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:59:23.072269 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.072200    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.176405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.176359    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": dial tcp 10.133.0.53:8000: connect: connection refused"
Nov 02 13:59:23.237846 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.176683    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.238303 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.176718    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.238792 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.179472    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.250988 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.250892    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:59:23.640891 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.640845    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Nov 02 13:59:23.659715 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.657448    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.865097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.834889    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:23.906744 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.893562    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/health\": context deadline exceeded"
Nov 02 13:59:23.986091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.981285    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:59:23.986091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:23.981353    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:24.034093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.033744    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.034305 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.034255    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.049216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.034681    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:59:24.049216 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.034757    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:59:24.049762 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.049721    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:24.050559 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.050528    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.050980 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.050956    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.051391 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.051367    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.068516 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.062140    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.096232 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.096178    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.125895 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.125849    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": dial tcp 10.133.0.53:8000: connect: connection refused"
Nov 02 13:59:24.161014 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.160917    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:59:24.337796 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.337503    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.382214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.356817    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 02 13:59:24.544097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.541558    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Nov 02 13:59:24.881166 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.879558    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:24.895214 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:24.895156    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.037137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.036325    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:59:25.075093 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.071124    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.083220 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.083168    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.110708 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.097606    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.111114 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.097646    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 02 13:59:25.111886 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.097690    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:59:25.131779 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.098607    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.131779 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.098847    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.144099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.136158    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": dial tcp 10.133.0.53:8000: connect: connection refused"
Nov 02 13:59:25.186111 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.162665    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:59:25.352250 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.352188    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.384162 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.383221    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.648051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.647944    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:25.712140 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.648380    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Nov 02 13:59:25.913278 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.878697    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:25.934008 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:25.933963    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.062096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.061125    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 13:59:26.084519 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.064538    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"]
Nov 02 13:59:26.135811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.135763    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.202546 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.186232    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.202546 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.187737    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.202546 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.195617    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.202546 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.196678    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.202546 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.197773    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 02 13:59:26.229262 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.216392    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:59:26.253485 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.243231    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.253485 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.243701    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": dial tcp 10.133.0.53:8000: connect: connection refused"
Nov 02 13:59:26.470156 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.400725    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:59:26.470156 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.448785    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:26.521473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.508118    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:59:26.521473 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.508931    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:59:26.550224 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.549527    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:59:26.550338 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.550267    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused"
Nov 02 13:59:26.708552 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.701105    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:26.708552 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.702500    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:59:26.800325 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.800277    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:59:26.801329 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.801178    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:59:26.805278 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.805256    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:59:26.824566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.822784    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:59:26.824566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.822850    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:59:26.824566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.822887    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:59:26.861903 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.861650    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:59:26.863226 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.863202    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:59:26.912432 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.905474    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 13:59:26.975292 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.975244    5453 generic.go:356] "Generic (PLEG): container finished" podID="ac1608f6-6d4b-4273-b463-759b115c1989" containerID="8486d20820489c4cc35826d5773f9042734f9e8092fca6253bd11899cebbb0c0" exitCode=0
Nov 02 13:59:26.975693 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.975397    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" event={"ID":"ac1608f6-6d4b-4273-b463-759b115c1989","Type":"ContainerDied","Data":"8486d20820489c4cc35826d5773f9042734f9e8092fca6253bd11899cebbb0c0"}
Nov 02 13:59:26.977981 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.977947    5453 generic.go:356] "Generic (PLEG): container finished" podID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerID="1f8eb2bfc10c38354b86c4a745e51679fc9bf1bf3a23e3e7046bab9fa149f06c" exitCode=0
Nov 02 13:59:26.979113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:26.979035    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" event={"ID":"59c0dd7f-56f0-4fba-bc05-3d831ea90471","Type":"ContainerDied","Data":"1f8eb2bfc10c38354b86c4a745e51679fc9bf1bf3a23e3e7046bab9fa149f06c"}
Nov 02 13:59:27.141433 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.141402    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:59:27.209397 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.209366    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:59:27.227958 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.227917    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-home\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-home\") pod \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") "
Nov 02 13:59:27.228151 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.227972    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-home\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-home\") pod \"ac1608f6-6d4b-4273-b463-759b115c1989\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") "
Nov 02 13:59:27.228151 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228010    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59c0dd7f-56f0-4fba-bc05-3d831ea90471-kube-api-access-czfjl\" (UniqueName: \"kubernetes.io/projected/59c0dd7f-56f0-4fba-bc05-3d831ea90471-kube-api-access-czfjl\") pod \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") "
Nov 02 13:59:27.228151 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228044    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-model-cache\") pod \"ac1608f6-6d4b-4273-b463-759b115c1989\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") "
Nov 02 13:59:27.228343 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228253    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac1608f6-6d4b-4273-b463-759b115c1989-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1608f6-6d4b-4273-b463-759b115c1989-tls-certs\") pod \"ac1608f6-6d4b-4273-b463-759b115c1989\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") "
Nov 02 13:59:27.228343 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228263    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-home" pod "59c0dd7f-56f0-4fba-bc05-3d831ea90471" (UID: "59c0dd7f-56f0-4fba-bc05-3d831ea90471"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.228439 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228334    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-home" pod "ac1608f6-6d4b-4273-b463-759b115c1989" (UID: "ac1608f6-6d4b-4273-b463-759b115c1989"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.228439 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228421    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-model-cache" pod "ac1608f6-6d4b-4273-b463-759b115c1989" (UID: "ac1608f6-6d4b-4273-b463-759b115c1989"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.228637 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228615    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-tmp-dir\") pod \"ac1608f6-6d4b-4273-b463-759b115c1989\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") "
Nov 02 13:59:27.228762 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228652    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tls-certs\" (UniqueName: \"kubernetes.io/secret/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tls-certs\") pod \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") "
Nov 02 13:59:27.228762 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228705    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-model-cache\") pod \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") "
Nov 02 13:59:27.228762 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228750    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac1608f6-6d4b-4273-b463-759b115c1989-kube-api-access-zbcfx\" (UniqueName: \"kubernetes.io/projected/ac1608f6-6d4b-4273-b463-759b115c1989-kube-api-access-zbcfx\") pod \"ac1608f6-6d4b-4273-b463-759b115c1989\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") "
Nov 02 13:59:27.228895 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228849    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-dshm\") pod \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") "
Nov 02 13:59:27.228895 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228871    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-tmp-dir" pod "ac1608f6-6d4b-4273-b463-759b115c1989" (UID: "ac1608f6-6d4b-4273-b463-759b115c1989"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.229196 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.228991    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-dshm\") pod \"ac1608f6-6d4b-4273-b463-759b115c1989\" (UID: \"ac1608f6-6d4b-4273-b463-759b115c1989\") "
Nov 02 13:59:27.229196 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.229033    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-model-cache" pod "59c0dd7f-56f0-4fba-bc05-3d831ea90471" (UID: "59c0dd7f-56f0-4fba-bc05-3d831ea90471"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.229196 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.229080    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tmp-dir\") pod \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\" (UID: \"59c0dd7f-56f0-4fba-bc05-3d831ea90471\") "
Nov 02 13:59:27.229664 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.229346    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tmp-dir" pod "59c0dd7f-56f0-4fba-bc05-3d831ea90471" (UID: "59c0dd7f-56f0-4fba-bc05-3d831ea90471"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.230455 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.230432    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.230564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.230458    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.230564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.230471    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.230564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.230487    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.230564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.230500    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.230564 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.230511    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.233688 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.233658    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-dshm" pod "59c0dd7f-56f0-4fba-bc05-3d831ea90471" (UID: "59c0dd7f-56f0-4fba-bc05-3d831ea90471"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.233785 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.233691    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tls-certs" pod "59c0dd7f-56f0-4fba-bc05-3d831ea90471" (UID: "59c0dd7f-56f0-4fba-bc05-3d831ea90471"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:59:27.233843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.233811    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1608f6-6d4b-4273-b463-759b115c1989-tls-certs" pod "ac1608f6-6d4b-4273-b463-759b115c1989" (UID: "ac1608f6-6d4b-4273-b463-759b115c1989"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:59:27.234531 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.234501    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c0dd7f-56f0-4fba-bc05-3d831ea90471-kube-api-access-czfjl" pod "59c0dd7f-56f0-4fba-bc05-3d831ea90471" (UID: "59c0dd7f-56f0-4fba-bc05-3d831ea90471"). InnerVolumeSpecName "kube-api-access-czfjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:27.235030 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.235010    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1608f6-6d4b-4273-b463-759b115c1989-kube-api-access-zbcfx" pod "ac1608f6-6d4b-4273-b463-759b115c1989" (UID: "ac1608f6-6d4b-4273-b463-759b115c1989"). InnerVolumeSpecName "kube-api-access-zbcfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:27.235541 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.235523    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-dshm" pod "ac1608f6-6d4b-4273-b463-759b115c1989" (UID: "ac1608f6-6d4b-4273-b463-759b115c1989"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:27.332643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.332555    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac1608f6-6d4b-4273-b463-759b115c1989-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.332643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.332587    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59c0dd7f-56f0-4fba-bc05-3d831ea90471-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.332643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.332597    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbcfx\" (UniqueName: \"kubernetes.io/projected/ac1608f6-6d4b-4273-b463-759b115c1989-kube-api-access-zbcfx\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.332643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.332606    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59c0dd7f-56f0-4fba-bc05-3d831ea90471-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.332643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.332616    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac1608f6-6d4b-4273-b463-759b115c1989-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.332643 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.332624    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czfjl\" (UniqueName: \"kubernetes.io/projected/59c0dd7f-56f0-4fba-bc05-3d831ea90471-kube-api-access-czfjl\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:27.731057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.730967    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:27.991837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.991729    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"
Nov 02 13:59:27.991837 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.991728    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8" event={"ID":"ac1608f6-6d4b-4273-b463-759b115c1989","Type":"ContainerDied","Data":"d145f864adcd44e874357a007719498d8f227e5b180da2b2709657e96104e3c6"}
Nov 02 13:59:27.992485 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.991871    5453 scope.go:122] "RemoveContainer" containerID="8486d20820489c4cc35826d5773f9042734f9e8092fca6253bd11899cebbb0c0"
Nov 02 13:59:27.997819 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.997783    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw" event={"ID":"59c0dd7f-56f0-4fba-bc05-3d831ea90471","Type":"ContainerDied","Data":"5a89351ec89c20604d6a77cced1eed87bcf098dabca682e36d0ddd4c07459673"}
Nov 02 13:59:27.997988 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:27.997885    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"
Nov 02 13:59:28.023126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:28.022636    5453 scope.go:122] "RemoveContainer" containerID="1f8eb2bfc10c38354b86c4a745e51679fc9bf1bf3a23e3e7046bab9fa149f06c"
Nov 02 13:59:28.046963 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:28.046921    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"]
Nov 02 13:59:28.054327 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:28.054293    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/premium-w5-1d18fb-kserve-75f6b69777-qtzk8"]
Nov 02 13:59:28.072910 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:28.072870    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"]
Nov 02 13:59:28.079619 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:28.079580    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-1d18fb/distinct-2-w5-1d18fb-kserve-579f76d6f9-896gw"]
Nov 02 13:59:28.202827 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:28.202793    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:29.055194 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:29.054950    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" path="/var/lib/kubelet/pods/59c0dd7f-56f0-4fba-bc05-3d831ea90471/volumes"
Nov 02 13:59:29.055874 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:29.055846    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" path="/var/lib/kubelet/pods/ac1608f6-6d4b-4273-b463-759b115c1989/volumes"
Nov 02 13:59:29.275437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:29.275396    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:30.204597 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:30.204563    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:31.201788 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:31.201742    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:32.107943 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:32.107861    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:32.396700 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:32.396273    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" podUID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 13:59:32.648456 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:32.648352    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"]
Nov 02 13:59:32.662323 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:32.662280    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"]
Nov 02 13:59:32.794629 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:32.794599    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:33.007906 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:33.007806    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:33.026995 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:33.026947    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"]
Nov 02 13:59:33.088091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:33.083208    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"]
Nov 02 13:59:33.193099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:33.179982    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:33.327574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:33.327505    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:33.925301 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:33.925270    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:34.722701 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:34.722664    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:34.994270 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:34.994239    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:59:35.110264 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.109611    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-plugins-config-volume\") pod \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") "
Nov 02 13:59:35.110264 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.109847    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-kube-api-access-g2xdm\" (UniqueName: \"kubernetes.io/projected/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-kube-api-access-g2xdm\") pod \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\" (UID: \"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4\") "
Nov 02 13:59:35.111499 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.111449    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-plugins-config-volume" pod "c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" (UID: "c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:59:35.114357 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.114252    5453 generic.go:356] "Generic (PLEG): container finished" podID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" containerID="8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8" exitCode=0
Nov 02 13:59:35.114812 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.114303    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" event={"ID":"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4","Type":"ContainerDied","Data":"8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8"}
Nov 02 13:59:35.114991 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.114383    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"
Nov 02 13:59:35.115103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.114980    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx" event={"ID":"c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4","Type":"ContainerDied","Data":"6054b0562c06b51674da727d0d292b874c3f3262486842181c5ecab1d94c93ae"}
Nov 02 13:59:35.115224 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.115211    5453 scope.go:122] "RemoveContainer" containerID="8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8"
Nov 02 13:59:35.124490 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.124450    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-kube-api-access-g2xdm" pod "c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" (UID: "c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4"). InnerVolumeSpecName "kube-api-access-g2xdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:35.166541 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.166090    5453 scope.go:122] "RemoveContainer" containerID="8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8"
Nov 02 13:59:35.166921 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:59:35.166814    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8\": container with ID starting with 8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8 not found: ID does not exist" containerID="8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8"
Nov 02 13:59:35.166921 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.166859    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8"} err="failed to get container status \"8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8\": rpc error: code = NotFound desc = could not find container \"8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8\": container with ID starting with 8c272a7dfe1b4b8aa82ec4fbd4aa3af3f223fa072775b6de5369516eb4d96af8 not found: ID does not exist"
Nov 02 13:59:35.212732 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.212613    5453 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-plugins-config-volume\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:35.212732 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.212649    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2xdm\" (UniqueName: \"kubernetes.io/projected/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4-kube-api-access-g2xdm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:35.469955 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.469853    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"]
Nov 02 13:59:35.497396 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.497293    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-1d18fb-5744785f9c-7h9gx"]
Nov 02 13:59:35.958092 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:35.952104    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:36.202215 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:59:36.198275    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 13:59:36.989797 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:36.980224    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/health\": context deadline exceeded"
Nov 02 13:59:37.193099 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.171235    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:37.246434 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.246298    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:37.268682 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.268636    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" path="/var/lib/kubelet/pods/c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4/volumes"
Nov 02 13:59:37.299055 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.299017    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:37.404222 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.404171    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:37.409581 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.409538    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:37.617007 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.616925    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:37.815242 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.815187    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 02 13:59:37.877436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.876321    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:37.932360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:37.931170    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": context deadline exceeded"
Nov 02 13:59:38.043211 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.043168    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" podUID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" containerName="payload-processing" containerID="cri-o://0a751babef84b7a3e6422550549fa689adeec1eb699a6f6b1b7e8b3289079398" gracePeriod=25
Nov 02 13:59:38.136036 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.086308    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" podUID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" containerName="payload-pre-processing" containerID="cri-o://a7f5cdd8fc43c62a049241828b98291445e300546c84e8f17414f5db415c3cc2" gracePeriod=25
Nov 02 13:59:38.173344 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.173293    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:38.200587 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.174684    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:59:38.410160 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.395610    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:59:38.435695 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.423720    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:38.435695 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.424035    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:59:38.533098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.490267    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:59:38.806097 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.800184    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:59:38.821095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.819190    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:38.821095 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.820370    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:59:38.914230 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.914180    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:38.914809 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.914780    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:59:39.155450 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.155338    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:39.156123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.044338    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:39.156613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.123175    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:39.179736 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.179693    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:59:39.181751 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:38.939198    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" probeResult="failure" output="Get \"https://10.133.0.78:8000/ready\": context deadline exceeded"
Nov 02 13:59:39.405662 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.403287    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": context deadline exceeded"
Nov 02 13:59:39.447430 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.447386    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:39.634493 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.631710    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:39.733276 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.716903    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:59:39.734015 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.733990    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 13:59:39.808103 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.807437    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:39.809110 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.808344    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:59:39.826006 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.825963    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:39.879866 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:39.867211    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.131792 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.128324    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.161283 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.161235    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.178360 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.178310    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.237096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.237036    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.255953 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.255917    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:59:40.263113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.256643    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:59:40.286142 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.285322    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.286538 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.286509    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:59:40.302983 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.302933    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:59:40.312411 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.312359    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 13:59:40.312709 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.312680    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.338286 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.338252    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 13:59:40.418525 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.410034    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.537574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.537544    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 13:59:40.537864 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.537836    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:59:40.537993 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.537982    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:59:40.538129 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.538118    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 13:59:40.558877 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.558835    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:40.656245 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.652162    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:40.718529 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.713146    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:59:40.895205 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.895152    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 02 13:59:40.934098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:40.897273    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:59:41.193400 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:41.181826    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:41.209096 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:41.206427    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:41.763061 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:41.760836    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:41.782125 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:41.770699    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" containerID="cri-o://5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6" gracePeriod=45
Nov 02 13:59:42.058896 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.058838    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:42.102798 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.102751    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:42.221286 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.202214    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": context deadline exceeded"
Nov 02 13:59:42.222040 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.207290    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:42.393350 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.354020    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:42.393350 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.370057    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:42.410841 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.410792    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": read tcp 10.133.0.2:42990->10.133.0.51:8000: read: connection reset by peer"
Nov 02 13:59:42.438621 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:59:42.420183    5453 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.083s"
Nov 02 13:59:42.438931 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.438915    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 13:59:42.439391 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.439241    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 13:59:42.439595 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.439582    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:59:42.439700 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.437995    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" podUID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 13:59:42.460755 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.455190    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:42.460755 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.455316    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"]
Nov 02 13:59:42.476453 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.473534    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" podUID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 13:59:42.597528 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.596052    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": context deadline exceeded"
Nov 02 13:59:42.664098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.662971    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:42.820116 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:42.820059    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 13:59:43.148650 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.148614    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:59:43.191872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.189992    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a7dc59d6-faef-4978-aee8-0558ef191f47-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7dc59d6-faef-4978-aee8-0558ef191f47-tls-certs\") pod \"a7dc59d6-faef-4978-aee8-0558ef191f47\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") "
Nov 02 13:59:43.191872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.190167    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-home\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-home\") pod \"a7dc59d6-faef-4978-aee8-0558ef191f47\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") "
Nov 02 13:59:43.191872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.190218    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-tmp-dir\") pod \"a7dc59d6-faef-4978-aee8-0558ef191f47\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") "
Nov 02 13:59:43.191872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.190286    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-model-cache\") pod \"a7dc59d6-faef-4978-aee8-0558ef191f47\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") "
Nov 02 13:59:43.191872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.190352    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-dshm\") pod \"a7dc59d6-faef-4978-aee8-0558ef191f47\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") "
Nov 02 13:59:43.191872 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.190534    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7dc59d6-faef-4978-aee8-0558ef191f47-kube-api-access-7vnqz\" (UniqueName: \"kubernetes.io/projected/a7dc59d6-faef-4978-aee8-0558ef191f47-kube-api-access-7vnqz\") pod \"a7dc59d6-faef-4978-aee8-0558ef191f47\" (UID: \"a7dc59d6-faef-4978-aee8-0558ef191f47\") "
Nov 02 13:59:43.195920 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.195887    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-model-cache" pod "a7dc59d6-faef-4978-aee8-0558ef191f47" (UID: "a7dc59d6-faef-4978-aee8-0558ef191f47"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:43.196274 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.196252    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-home" pod "a7dc59d6-faef-4978-aee8-0558ef191f47" (UID: "a7dc59d6-faef-4978-aee8-0558ef191f47"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:43.196422 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.196327    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-tmp-dir" pod "a7dc59d6-faef-4978-aee8-0558ef191f47" (UID: "a7dc59d6-faef-4978-aee8-0558ef191f47"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:43.266098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.250348    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7dc59d6-faef-4978-aee8-0558ef191f47-tls-certs" pod "a7dc59d6-faef-4978-aee8-0558ef191f47" (UID: "a7dc59d6-faef-4978-aee8-0558ef191f47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:59:43.266098 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.250861    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-dshm" pod "a7dc59d6-faef-4978-aee8-0558ef191f47" (UID: "a7dc59d6-faef-4978-aee8-0558ef191f47"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:43.311637 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.311599    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7dc59d6-faef-4978-aee8-0558ef191f47-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:43.311987 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.311964    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:43.312137 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.312125    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:43.312252 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.312239    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:43.312342 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.312331    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7dc59d6-faef-4978-aee8-0558ef191f47-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:43.323132 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.316280    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7dc59d6-faef-4978-aee8-0558ef191f47-kube-api-access-7vnqz" pod "a7dc59d6-faef-4978-aee8-0558ef191f47" (UID: "a7dc59d6-faef-4978-aee8-0558ef191f47"). InnerVolumeSpecName "kube-api-access-7vnqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:43.340121 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.327285    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:43.379917 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.379851    5453 generic.go:356] "Generic (PLEG): container finished" podID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerID="5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6" exitCode=0
Nov 02 13:59:43.380190 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.380162    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" event={"ID":"a7dc59d6-faef-4978-aee8-0558ef191f47","Type":"ContainerDied","Data":"5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6"}
Nov 02 13:59:43.380281 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.380234    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" event={"ID":"a7dc59d6-faef-4978-aee8-0558ef191f47","Type":"ContainerDied","Data":"722773de87d414724926596c5625b706ef19e0bbef89048ad0c36176c3cea7c2"}
Nov 02 13:59:43.380281 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.380261    5453 scope.go:122] "RemoveContainer" containerID="5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6"
Nov 02 13:59:43.380708 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.380112    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"
Nov 02 13:59:43.401265 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.401237    5453 scope.go:122] "RemoveContainer" containerID="5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6"
Nov 02 13:59:43.416102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.414996    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vnqz\" (UniqueName: \"kubernetes.io/projected/a7dc59d6-faef-4978-aee8-0558ef191f47-kube-api-access-7vnqz\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:43.416102 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:59:43.415609    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6\": container with ID starting with 5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6 not found: ID does not exist" containerID="5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6"
Nov 02 13:59:43.416102 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.415648    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6"} err="failed to get container status \"5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6\": rpc error: code = NotFound desc = could not find container \"5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6\": container with ID starting with 5354cff67a618b98427ad0251a51401cbbddc19373e52600b7dc4a4d7bb1f4d6 not found: ID does not exist"
Nov 02 13:59:43.439290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.438359    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"]
Nov 02 13:59:43.443436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.443374    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c"]
Nov 02 13:59:43.863622 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:43.863577    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-1eb567/simulator-w6-1eb567-kserve-68fdcd965-rfw4c" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:44.413264 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:44.413215    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:44.546774 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:44.546740    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:45.046998 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.046967    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" path="/var/lib/kubelet/pods/a7dc59d6-faef-4978-aee8-0558ef191f47/volumes"
Nov 02 13:59:45.121496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.121463    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"]
Nov 02 13:59:45.122437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122313    5453 cpu_manager.go:414] "containerMap: removing container" podUID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" containerName="payload-processing"
Nov 02 13:59:45.122437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122340    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" containerName="payload-processing"
Nov 02 13:59:45.122437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122362    5453 cpu_manager.go:414] "containerMap: removing container" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main"
Nov 02 13:59:45.122437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122370    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main"
Nov 02 13:59:45.122437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122383    5453 cpu_manager.go:414] "containerMap: removing container" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main"
Nov 02 13:59:45.122437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122391    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main"
Nov 02 13:59:45.122437 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122442    5453 cpu_manager.go:414] "containerMap: removing container" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main"
Nov 02 13:59:45.122942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122450    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main"
Nov 02 13:59:45.122942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122620    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="c549e9a1-2e91-4d6c-98f0-f1696fdcd2e4" containerName="payload-processing"
Nov 02 13:59:45.122942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122638    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="59c0dd7f-56f0-4fba-bc05-3d831ea90471" containerName="main"
Nov 02 13:59:45.122942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122649    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac1608f6-6d4b-4273-b463-759b115c1989" containerName="main"
Nov 02 13:59:45.122942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.122666    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7dc59d6-faef-4978-aee8-0558ef191f47" containerName="main"
Nov 02 13:59:45.127943 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.127884    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.138558 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.137859    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 13:59:45.154396 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.154371    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jg4tb\""
Nov 02 13:59:45.164353 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.164316    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"]
Nov 02 13:59:45.250496 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.250458    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv2mc\" (UniqueName: \"kubernetes.io/projected/c326e938-8b04-447b-93df-34bd878f033b-kube-api-access-qv2mc\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.250732 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.250528    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c326e938-8b04-447b-93df-34bd878f033b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.250816 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.250718    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c326e938-8b04-447b-93df-34bd878f033b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.353421 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.353325    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv2mc\" (UniqueName: \"kubernetes.io/projected/c326e938-8b04-447b-93df-34bd878f033b-kube-api-access-qv2mc\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.353421 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.353410    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c326e938-8b04-447b-93df-34bd878f033b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.353685 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.353512    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c326e938-8b04-447b-93df-34bd878f033b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.354378 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.354345    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c326e938-8b04-447b-93df-34bd878f033b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.356921 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.356892    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c326e938-8b04-447b-93df-34bd878f033b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.366013 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.365976    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv2mc\" (UniqueName: \"kubernetes.io/projected/c326e938-8b04-447b-93df-34bd878f033b-kube-api-access-qv2mc\") pod \"maas-api-revoke-sub-0035b537-w4s2q\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.470268 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.470231    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:45.589863 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.586196    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:45.764291 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.764256    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"]
Nov 02 13:59:45.764797 ip-10-0-131-166 kubenswrapper[5453]: W1102 13:59:45.764762    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc326e938_8b04_447b_93df_34bd878f033b.slice/crio-9c29dd897999dd3aeb0e35466d3f503f3d7c4ef42f69e94f738c598fa237a731 WatchSource:0}: Error finding container 9c29dd897999dd3aeb0e35466d3f503f3d7c4ef42f69e94f738c598fa237a731: Status 404 returned error can't find the container with id 9c29dd897999dd3aeb0e35466d3f503f3d7c4ef42f69e94f738c598fa237a731
Nov 02 13:59:45.766811 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:45.766787    5453 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 13:59:46.396479 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:46.396437    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:46.422762 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:46.422674    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q" event={"ID":"c326e938-8b04-447b-93df-34bd878f033b","Type":"ContainerStarted","Data":"9c29dd897999dd3aeb0e35466d3f503f3d7c4ef42f69e94f738c598fa237a731"}
Nov 02 13:59:47.374414 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:47.374368    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:47.603094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:47.598908    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:47.700369 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:47.700264    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" containerID="cri-o://e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f" gracePeriod=45
Nov 02 13:59:47.729714 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:47.729667    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main" containerID="cri-o://48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69" gracePeriod=45
Nov 02 13:59:47.759108 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:47.751525    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:48.145550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.145477    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:48.258376 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.258345    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:59:48.292532 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.292444    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:59:48.385119 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.384981    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:48.456641 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.456605    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tmp-dir\") pod \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") "
Nov 02 13:59:48.456843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.456676    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aeec8ee0-b48c-46ba-b5a6-e156f554e492-kube-api-access-lfnx4\" (UniqueName: \"kubernetes.io/projected/aeec8ee0-b48c-46ba-b5a6-e156f554e492-kube-api-access-lfnx4\") pod \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") "
Nov 02 13:59:48.456843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.456723    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-home\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-home\") pod \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") "
Nov 02 13:59:48.456843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.456772    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-model-cache\") pod \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") "
Nov 02 13:59:48.456843 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.456828    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-model-cache\") pod \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") "
Nov 02 13:59:48.457051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.456901    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tmp-dir\") pod \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") "
Nov 02 13:59:48.457051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.456965    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-dshm\") pod \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") "
Nov 02 13:59:48.457051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.457011    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-home\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-home\") pod \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") "
Nov 02 13:59:48.457262 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.457152    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-dshm\") pod \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") "
Nov 02 13:59:48.457262 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.457192    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tls-certs\" (UniqueName: \"kubernetes.io/secret/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tls-certs\") pod \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\" (UID: \"aeec8ee0-b48c-46ba-b5a6-e156f554e492\") "
Nov 02 13:59:48.457262 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.457223    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-kube-api-access-5w2jx\" (UniqueName: \"kubernetes.io/projected/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-kube-api-access-5w2jx\") pod \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") "
Nov 02 13:59:48.457405 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.457264    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tls-certs\") pod \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\" (UID: \"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb\") "
Nov 02 13:59:48.458703 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.458446    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-home" pod "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" (UID: "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.459217 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.459148    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tmp-dir" pod "aeec8ee0-b48c-46ba-b5a6-e156f554e492" (UID: "aeec8ee0-b48c-46ba-b5a6-e156f554e492"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.459829 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.459426    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-model-cache" pod "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" (UID: "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.459829 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.459627    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-home" pod "aeec8ee0-b48c-46ba-b5a6-e156f554e492" (UID: "aeec8ee0-b48c-46ba-b5a6-e156f554e492"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.459829 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.459669    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tmp-dir" pod "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" (UID: "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.460057 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.459955    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-model-cache" pod "aeec8ee0-b48c-46ba-b5a6-e156f554e492" (UID: "aeec8ee0-b48c-46ba-b5a6-e156f554e492"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.460613 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.460590    5453 generic.go:356] "Generic (PLEG): container finished" podID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerID="48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69" exitCode=0
Nov 02 13:59:48.460803 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.460788    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"
Nov 02 13:59:48.461230 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.461187    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" event={"ID":"aeec8ee0-b48c-46ba-b5a6-e156f554e492","Type":"ContainerDied","Data":"48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69"}
Nov 02 13:59:48.461347 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.461232    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc" event={"ID":"aeec8ee0-b48c-46ba-b5a6-e156f554e492","Type":"ContainerDied","Data":"9e32fefcfe155cd34e4c5fb88461c3c8f801532f456e7b80928d7a50e8d1c41f"}
Nov 02 13:59:48.461347 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.461258    5453 scope.go:122] "RemoveContainer" containerID="48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69"
Nov 02 13:59:48.462345 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.462314    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-dshm" pod "aeec8ee0-b48c-46ba-b5a6-e156f554e492" (UID: "aeec8ee0-b48c-46ba-b5a6-e156f554e492"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.465833 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.465793    5453 generic.go:356] "Generic (PLEG): container finished" podID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerID="e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f" exitCode=0
Nov 02 13:59:48.465952 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.465922    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" event={"ID":"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb","Type":"ContainerDied","Data":"e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f"}
Nov 02 13:59:48.466006 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.465961    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" event={"ID":"0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb","Type":"ContainerDied","Data":"7a00593c4a76118c46c7dded2c1071e3f1e75b7847276873221656722bbab4f2"}
Nov 02 13:59:48.466051 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.466034    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"
Nov 02 13:59:48.468507 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.468450    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tls-certs" pod "aeec8ee0-b48c-46ba-b5a6-e156f554e492" (UID: "aeec8ee0-b48c-46ba-b5a6-e156f554e492"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:59:48.468878 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.468819    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-kube-api-access-5w2jx" pod "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" (UID: "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb"). InnerVolumeSpecName "kube-api-access-5w2jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:48.469343 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.469153    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-dshm" pod "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" (UID: "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:48.469343 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.469158    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeec8ee0-b48c-46ba-b5a6-e156f554e492-kube-api-access-lfnx4" pod "aeec8ee0-b48c-46ba-b5a6-e156f554e492" (UID: "aeec8ee0-b48c-46ba-b5a6-e156f554e492"). InnerVolumeSpecName "kube-api-access-lfnx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:48.474820 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.474786    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tls-certs" pod "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" (UID: "0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:59:48.486576 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.486546    5453 scope.go:122] "RemoveContainer" containerID="48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69"
Nov 02 13:59:48.487007 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:59:48.486979    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69\": container with ID starting with 48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69 not found: ID does not exist" containerID="48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69"
Nov 02 13:59:48.487123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.487021    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69"} err="failed to get container status \"48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69\": rpc error: code = NotFound desc = could not find container \"48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69\": container with ID starting with 48dff9937613e679364edd071fe012ab38cd2de95609859da060eeaf6b881f69 not found: ID does not exist"
Nov 02 13:59:48.487123 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.487047    5453 scope.go:122] "RemoveContainer" containerID="e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f"
Nov 02 13:59:48.499975 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.499841    5453 scope.go:122] "RemoveContainer" containerID="e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f"
Nov 02 13:59:48.500431 ip-10-0-131-166 kubenswrapper[5453]: E1102 13:59:48.500380    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f\": container with ID starting with e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f not found: ID does not exist" containerID="e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f"
Nov 02 13:59:48.500431 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.500445    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f"} err="failed to get container status \"e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f\": rpc error: code = NotFound desc = could not find container \"e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f\": container with ID starting with e171bc90f9f9d6fbbf9655d25117d386431851ab4d602a31a17a7b3c54a54b9f not found: ID does not exist"
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.559997    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560040    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfnx4\" (UniqueName: \"kubernetes.io/projected/aeec8ee0-b48c-46ba-b5a6-e156f554e492-kube-api-access-lfnx4\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560055    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560099    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560115    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560128    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560142    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeec8ee0-b48c-46ba-b5a6-e156f554e492-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560154    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560167    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560180    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeec8ee0-b48c-46ba-b5a6-e156f554e492-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560195    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w2jx\" (UniqueName: \"kubernetes.io/projected/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-kube-api-access-5w2jx\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.560296 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.560208    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:48.792180 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.792131    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"]
Nov 02 13:59:48.797458 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.797422    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/premium-w3-4fc49b-kserve-98b54657c-6q2cc"]
Nov 02 13:59:48.811178 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.811085    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"]
Nov 02 13:59:48.815363 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:48.815329    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx"]
Nov 02 13:59:49.046306 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:49.046265    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" path="/var/lib/kubelet/pods/0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb/volumes"
Nov 02 13:59:49.046876 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:49.046853    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" path="/var/lib/kubelet/pods/aeec8ee0-b48c-46ba-b5a6-e156f554e492/volumes"
Nov 02 13:59:49.116462 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:49.116362    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-4fc49b/distinct-w3-4fc49b-kserve-76d5cf79f6-lmxjx" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 13:59:49.532045 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:49.531904    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:49.690489 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:49.690453    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"]
Nov 02 13:59:49.828550 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:49.828449    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:50.036113 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:50.010797    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:50.725803 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:50.725767    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:50.876203 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:50.876153    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:51.502920 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:51.502823    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q" event={"ID":"c326e938-8b04-447b-93df-34bd878f033b","Type":"ContainerStarted","Data":"be06bf38935bdf972522b2765a1b698454e6266ee0223e1047d64b21673b4637"}
Nov 02 13:59:51.534641 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:51.534583    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q" podStartSLOduration=1.577098259 podStartE2EDuration="6.534566s" totalImagesPullingTime="4.957467741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:59:51.531773582 +0000 UTC m=+970.612918714" watchObservedRunningTime="2026-11-02 13:59:51.534566 +0000 UTC m=+970.615711194"
Nov 02 13:59:51.703300 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:51.703264    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:52.397114 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:52.397051    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" podUID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 13:59:52.397665 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:52.397622    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" podUID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 13:59:52.515240 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:52.515205    5453 generic.go:356] "Generic (PLEG): container finished" podID="c326e938-8b04-447b-93df-34bd878f033b" containerID="be06bf38935bdf972522b2765a1b698454e6266ee0223e1047d64b21673b4637" exitCode=0
Nov 02 13:59:52.515422 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:52.515296    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q" event={"ID":"c326e938-8b04-447b-93df-34bd878f033b","Type":"ContainerDied","Data":"be06bf38935bdf972522b2765a1b698454e6266ee0223e1047d64b21673b4637"}
Nov 02 13:59:52.665778 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:52.665594    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:52.808558 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:52.808523    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:53.546027 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.545975    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:53.888183 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.888152    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:53.983288 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.983234    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c326e938-8b04-447b-93df-34bd878f033b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c326e938-8b04-447b-93df-34bd878f033b-maas-api-xks-ca\") pod \"c326e938-8b04-447b-93df-34bd878f033b\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") "
Nov 02 13:59:53.983478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.983403    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c326e938-8b04-447b-93df-34bd878f033b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c326e938-8b04-447b-93df-34bd878f033b-maas-api-openshift-ca\") pod \"c326e938-8b04-447b-93df-34bd878f033b\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") "
Nov 02 13:59:53.983566 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.983501    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c326e938-8b04-447b-93df-34bd878f033b-kube-api-access-qv2mc\" (UniqueName: \"kubernetes.io/projected/c326e938-8b04-447b-93df-34bd878f033b-kube-api-access-qv2mc\") pod \"c326e938-8b04-447b-93df-34bd878f033b\" (UID: \"c326e938-8b04-447b-93df-34bd878f033b\") "
Nov 02 13:59:53.983838 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.983815    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c326e938-8b04-447b-93df-34bd878f033b-maas-api-openshift-ca" pod "c326e938-8b04-447b-93df-34bd878f033b" (UID: "c326e938-8b04-447b-93df-34bd878f033b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:59:53.984517 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.984459    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c326e938-8b04-447b-93df-34bd878f033b-maas-api-openshift-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:53.985794 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.985765    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c326e938-8b04-447b-93df-34bd878f033b-maas-api-xks-ca" pod "c326e938-8b04-447b-93df-34bd878f033b" (UID: "c326e938-8b04-447b-93df-34bd878f033b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:59:53.985901 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:53.985859    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c326e938-8b04-447b-93df-34bd878f033b-kube-api-access-qv2mc" pod "c326e938-8b04-447b-93df-34bd878f033b" (UID: "c326e938-8b04-447b-93df-34bd878f033b"). InnerVolumeSpecName "kube-api-access-qv2mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:54.086451 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.086417    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv2mc\" (UniqueName: \"kubernetes.io/projected/c326e938-8b04-447b-93df-34bd878f033b-kube-api-access-qv2mc\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:54.086660 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.086452    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c326e938-8b04-447b-93df-34bd878f033b-maas-api-xks-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:54.389614 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.389576    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:54.534207 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.534170    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q" event={"ID":"c326e938-8b04-447b-93df-34bd878f033b","Type":"ContainerDied","Data":"9c29dd897999dd3aeb0e35466d3f503f3d7c4ef42f69e94f738c598fa237a731"}
Nov 02 13:59:54.534207 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.534190    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"
Nov 02 13:59:54.534436 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.534224    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c29dd897999dd3aeb0e35466d3f503f3d7c4ef42f69e94f738c598fa237a731"
Nov 02 13:59:54.691228 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.691116    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" podUID="c2935f3c-7d58-4bc1-a530-574129413527" containerName="payload-processing" containerID="cri-o://86f3fb81054763333155d2f88e02e995f2d19c07038734745d32a91b441e88d1" gracePeriod=25
Nov 02 13:59:54.799920 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.799882    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:54.933574 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:54.933542    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:55.097190 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:55.094989    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"]
Nov 02 13:59:55.097190 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:55.095356    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" containerID="cri-o://00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9" gracePeriod=30
Nov 02 13:59:55.102168 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:55.101175    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"]
Nov 02 13:59:55.102168 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:55.101440    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" containerID="cri-o://b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c" gracePeriod=30
Nov 02 13:59:55.176675 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:55.176628    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:55.339637 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:55.339592    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:56.155415 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:56.153461    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:56.872023 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:56.871993    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:57.021375 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:57.021342    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:57.618605 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:57.618565    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" containerID="cri-o://70c6f4a01527dbf852f6eb78e9893d26a7703f593701129eb62079a647d35a04" gracePeriod=45
Nov 02 13:59:57.845557 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:57.845490    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": dial tcp 10.133.0.64:8000: connect: connection refused"
Nov 02 13:59:58.286126 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.279997    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 13:59:58.876486 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.876022    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 13:59:58.876486 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.876195    5453 generic.go:356] "Generic (PLEG): container finished" podID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerID="70c6f4a01527dbf852f6eb78e9893d26a7703f593701129eb62079a647d35a04" exitCode=0
Nov 02 13:59:58.876486 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.876463    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" event={"ID":"6de45f8c-8886-4505-9ac6-6b0b01cb4f04","Type":"ContainerDied","Data":"70c6f4a01527dbf852f6eb78e9893d26a7703f593701129eb62079a647d35a04"}
Nov 02 13:59:58.885690 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.876915    5453 scope.go:122] "RemoveContainer" containerID="70c6f4a01527dbf852f6eb78e9893d26a7703f593701129eb62079a647d35a04"
Nov 02 13:59:58.978942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.978135    5453 generic.go:356] "Generic (PLEG): container finished" podID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" containerID="0a751babef84b7a3e6422550549fa689adeec1eb699a6f6b1b7e8b3289079398" exitCode=0
Nov 02 13:59:58.978942 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.978383    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" event={"ID":"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4","Type":"ContainerDied","Data":"0a751babef84b7a3e6422550549fa689adeec1eb699a6f6b1b7e8b3289079398"}
Nov 02 13:59:58.993853 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.993698    5453 generic.go:356] "Generic (PLEG): container finished" podID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" containerID="a7f5cdd8fc43c62a049241828b98291445e300546c84e8f17414f5db415c3cc2" exitCode=0
Nov 02 13:59:58.993853 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:58.993772    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" event={"ID":"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb","Type":"ContainerDied","Data":"a7f5cdd8fc43c62a049241828b98291445e300546c84e8f17414f5db415c3cc2"}
Nov 02 13:59:59.022478 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.022437    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-kube-api-access-28qtl\" (UniqueName: \"kubernetes.io/projected/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-kube-api-access-28qtl\") pod \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") "
Nov 02 13:59:59.022733 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.022715    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tls-certs\" (UniqueName: \"kubernetes.io/secret/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tls-certs\") pod \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") "
Nov 02 13:59:59.023028 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.023012    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tmp-dir\") pod \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") "
Nov 02 13:59:59.047367 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.023203    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-model-cache\") pod \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") "
Nov 02 13:59:59.047714 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.047682    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-home\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-home\") pod \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") "
Nov 02 13:59:59.047914 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.047897    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-dshm\") pod \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\" (UID: \"6de45f8c-8886-4505-9ac6-6b0b01cb4f04\") "
Nov 02 13:59:59.049517 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.049487    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-model-cache" pod "6de45f8c-8886-4505-9ac6-6b0b01cb4f04" (UID: "6de45f8c-8886-4505-9ac6-6b0b01cb4f04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:59.070783 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.067900    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tmp-dir" pod "6de45f8c-8886-4505-9ac6-6b0b01cb4f04" (UID: "6de45f8c-8886-4505-9ac6-6b0b01cb4f04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:59.096094 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.094467    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-home" pod "6de45f8c-8886-4505-9ac6-6b0b01cb4f04" (UID: "6de45f8c-8886-4505-9ac6-6b0b01cb4f04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 13:59:59.148598 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.148143    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 13:59:59.148598 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.148245    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 13:59:59.163555 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.150651    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:59.163555 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.162125    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:59.163555 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.162156    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:59.420104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.363279    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tls-certs" pod "6de45f8c-8886-4505-9ac6-6b0b01cb4f04" (UID: "6de45f8c-8886-4505-9ac6-6b0b01cb4f04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 13:59:59.420104 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.364420    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-kube-api-access-28qtl" pod "6de45f8c-8886-4505-9ac6-6b0b01cb4f04" (UID: "6de45f8c-8886-4505-9ac6-6b0b01cb4f04"). InnerVolumeSpecName "kube-api-access-28qtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:59.492483 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.458576    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 13:59:59.492483 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.489767    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28qtl\" (UniqueName: \"kubernetes.io/projected/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-kube-api-access-28qtl\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:59.492483 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.489809    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:59.541621 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.538144    5453 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 13:59:59.541621 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.538235    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 13:59:59.601836 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.601786    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-plugins-config-volume\") pod \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") "
Nov 02 13:59:59.602334 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.602307    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-kube-api-access-fd6xg\" (UniqueName: \"kubernetes.io/projected/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-kube-api-access-fd6xg\") pod \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\" (UID: \"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4\") "
Nov 02 13:59:59.827045 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.826573    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-plugins-config-volume" pod "918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" (UID: "918d316e-ed3a-4feb-9cd3-4ca428e7f3d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 13:59:59.898680 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.898638    5453 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-plugins-config-volume\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 13:59:59.916290 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.916210    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-kube-api-access-fd6xg" pod "918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" (UID: "918d316e-ed3a-4feb-9cd3-4ca428e7f3d4"). InnerVolumeSpecName "kube-api-access-fd6xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 13:59:59.938091 ip-10-0-131-166 kubenswrapper[5453]: I1102 13:59:59.920951    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-dshm" pod "6de45f8c-8886-4505-9ac6-6b0b01cb4f04" (UID: "6de45f8c-8886-4505-9ac6-6b0b01cb4f04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.038218 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.031808    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd6xg\" (UniqueName: \"kubernetes.io/projected/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4-kube-api-access-fd6xg\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.038218 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.031850    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6de45f8c-8886-4505-9ac6-6b0b01cb4f04-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.087190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.086137    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:00:00.104019 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.094153    5453 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:00:00.198097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.189307    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"]
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.281928    5453 cpu_manager.go:414] "containerMap: removing container" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.281960    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.281994    5453 cpu_manager.go:414] "containerMap: removing container" podUID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" containerName="payload-processing"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282002    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" containerName="payload-processing"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282025    5453 cpu_manager.go:414] "containerMap: removing container" podUID="c326e938-8b04-447b-93df-34bd878f033b" containerName="revoke-keys"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282034    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c326e938-8b04-447b-93df-34bd878f033b" containerName="revoke-keys"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282058    5453 cpu_manager.go:414] "containerMap: removing container" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282089    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282128    5453 cpu_manager.go:414] "containerMap: removing container" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282135    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282328    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b1bdb2c-fae4-4fcf-9e9c-b57829e49deb" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282355    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" containerName="payload-processing"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282366    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="c326e938-8b04-447b-93df-34bd878f033b" containerName="revoke-keys"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282381    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="aeec8ee0-b48c-46ba-b5a6-e156f554e492" containerName="main"
Nov 02 14:00:00.290650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.282395    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" containerName="main"
Nov 02 14:00:00.301836 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.292938    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"
Nov 02 14:00:00.303455 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.302287    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"
Nov 02 14:00:00.323542 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.323510    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"]
Nov 02 14:00:00.325189 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.323915    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.334404 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.334344    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jg4tb\""
Nov 02 14:00:00.335605 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.335580    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"]
Nov 02 14:00:00.335841 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.335826    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"]
Nov 02 14:00:00.335969 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.335951    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7" event={"ID":"6de45f8c-8886-4505-9ac6-6b0b01cb4f04","Type":"ContainerDied","Data":"252eb37aa67e6a160d919492004c58e69095a04c6d85423503e266b1f584ead5"}
Nov 02 14:00:00.336204 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.336060    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm" event={"ID":"918d316e-ed3a-4feb-9cd3-4ca428e7f3d4","Type":"ContainerDied","Data":"62fbf454969078abb76559c212d5c291956e00d2b82b1d17a0fc25c18bc2935e"}
Nov 02 14:00:00.336429 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.336392    5453 scope.go:122] "RemoveContainer" containerID="0a751babef84b7a3e6422550549fa689adeec1eb699a6f6b1b7e8b3289079398"
Nov 02 14:00:00.336827 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.336629    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 14:00:00.336922 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.336694    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.428182 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.428121    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"]
Nov 02 14:00:00.436782 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.436712    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/distinct-2-w1-f2e945-kserve-7b66bf48c4-tm5z7"]
Nov 02 14:00:00.449623 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.449583    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"]
Nov 02 14:00:00.450649 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.450606    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-kube-api-access-9kfvs\" (UniqueName: \"kubernetes.io/projected/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-kube-api-access-9kfvs\") pod \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") "
Nov 02 14:00:00.450775 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.450699    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-plugins-config-volume\") pod \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\" (UID: \"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb\") "
Nov 02 14:00:00.451351 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.451318    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.451472 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.451418    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5vcv\" (UniqueName: \"kubernetes.io/projected/3c8c17a4-0eab-420d-9d21-90bf56768a59-kube-api-access-n5vcv\") pod \"maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.451537 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.451498    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8c17a4-0eab-420d-9d21-90bf56768a59-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.451596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.451548    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kst9\" (UniqueName: \"kubernetes.io/projected/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-kube-api-access-7kst9\") pod \"maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.452723 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.452687    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-plugins-config-volume" pod "fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" (UID: "fd52a1bb-8e49-4fd4-b245-e6056ffa66cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:00.455002 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.454975    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-1eb567-775884c7f9-zscsm"]
Nov 02 14:00:00.462995 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.462734    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-kube-api-access-9kfvs" pod "fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" (UID: "fd52a1bb-8e49-4fd4-b245-e6056ffa66cb"). InnerVolumeSpecName "kube-api-access-9kfvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:00.560103 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.559901    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.560103 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.560019    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5vcv\" (UniqueName: \"kubernetes.io/projected/3c8c17a4-0eab-420d-9d21-90bf56768a59-kube-api-access-n5vcv\") pod \"maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.562525 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.560453    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8c17a4-0eab-420d-9d21-90bf56768a59-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.562525 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.560515    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kst9\" (UniqueName: \"kubernetes.io/projected/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-kube-api-access-7kst9\") pod \"maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.562525 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.560726    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kfvs\" (UniqueName: \"kubernetes.io/projected/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-kube-api-access-9kfvs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.562525 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.560748    5453 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb-plugins-config-volume\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.562525 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.561989    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.563617 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.563590    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8c17a4-0eab-420d-9d21-90bf56768a59-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.577091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.576490    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kst9\" (UniqueName: \"kubernetes.io/projected/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-kube-api-access-7kst9\") pod \"maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.583200 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.582927    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5vcv\" (UniqueName: \"kubernetes.io/projected/3c8c17a4-0eab-420d-9d21-90bf56768a59-kube-api-access-n5vcv\") pod \"maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.730163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.730128    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:00.733300 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.733263    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:00.750312 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.750286    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 14:00:00.768775 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.768738    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 14:00:00.775396 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775364    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e06e2fae-c590-42e1-854d-b30c9232dac8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06e2fae-c590-42e1-854d-b30c9232dac8-istiod-ca-cert\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.775749 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775474    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-kube-api-access-4lnvf\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-kube-api-access-4lnvf\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.775749 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775514    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-token\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-token\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.775749 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775565    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36f97e8c-874a-43b3-ab70-10d2984d41a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36f97e8c-874a-43b3-ab70-10d2984d41a6-istiod-ca-cert\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.775749 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775631    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-podinfo\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.775749 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775689    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-kube-api-access-g87l4\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-kube-api-access-g87l4\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.775749 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775742    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-data\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.776060 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775843    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-podinfo\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.776060 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.775884    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-certs\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.776909 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.776877    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-certs" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.777275 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.777245    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36f97e8c-874a-43b3-ab70-10d2984d41a6-istiod-ca-cert" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:00.777793 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.777765    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-data" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.778172 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.778131    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06e2fae-c590-42e1-854d-b30c9232dac8-istiod-ca-cert" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:00.780008 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.779976    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-podinfo" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:00.780516 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.780487    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-podinfo" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:00.780983 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.780960    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-kube-api-access-4lnvf" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "kube-api-access-4lnvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:00.783146 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.783116    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-token" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:00.783293 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.783119    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-kube-api-access-g87l4" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "kube-api-access-g87l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.877511    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-data\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.877571    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-envoy\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.877600    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-credential-socket\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.878051    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-data" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.878964    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-token\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-token\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.879015    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-envoy\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.879063    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-socket\") pod \"36f97e8c-874a-43b3-ab70-10d2984d41a6\" (UID: \"36f97e8c-874a-43b3-ab70-10d2984d41a6\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.879109    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-credential-socket\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.879154    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-socket\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.879204    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-certs\") pod \"e06e2fae-c590-42e1-854d-b30c9232dac8\" (UID: \"e06e2fae-c590-42e1-854d-b30c9232dac8\") "
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.887831    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-credential-socket" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.887962    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-socket" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.889711    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-certs" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.898001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.893173    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-token" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.898404    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-credential-socket" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.898531    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-socket" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.898706    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-envoy" pod "e06e2fae-c590-42e1-854d-b30c9232dac8" (UID: "e06e2fae-c590-42e1-854d-b30c9232dac8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.910799    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912005    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912031    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912099    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912118    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912157    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912170    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912182    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912195    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912231    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912243    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06e2fae-c590-42e1-854d-b30c9232dac8-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912256    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06e2fae-c590-42e1-854d-b30c9232dac8-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912268    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lnvf\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-kube-api-access-4lnvf\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912300    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06e2fae-c590-42e1-854d-b30c9232dac8-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912312    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36f97e8c-874a-43b3-ab70-10d2984d41a6-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912324    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912337    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g87l4\" (UniqueName: \"kubernetes.io/projected/36f97e8c-874a-43b3-ab70-10d2984d41a6-kube-api-access-g87l4\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.913607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.912349    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:00.915806 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:00.915751    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-envoy" pod "36f97e8c-874a-43b3-ab70-10d2984d41a6" (UID: "36f97e8c-874a-43b3-ab70-10d2984d41a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:01.014536 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.014480    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36f97e8c-874a-43b3-ab70-10d2984d41a6-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:01.050322 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.050283    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6de45f8c-8886-4505-9ac6-6b0b01cb4f04" path="/var/lib/kubelet/pods/6de45f8c-8886-4505-9ac6-6b0b01cb4f04/volumes"
Nov 02 14:00:01.051190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.051164    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="918d316e-ed3a-4feb-9cd3-4ca428e7f3d4" path="/var/lib/kubelet/pods/918d316e-ed3a-4feb-9cd3-4ca428e7f3d4/volumes"
Nov 02 14:00:01.080703 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.080673    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"]
Nov 02 14:00:01.081947 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:01.081921    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7138e706_fb6e_4c40_9a48_b6f8f5cc25ee.slice/crio-8859f870dbe929bf2b582d60825b44eaafa957540e9e363249ff8958d14b06d2 WatchSource:0}: Error finding container 8859f870dbe929bf2b582d60825b44eaafa957540e9e363249ff8958d14b06d2: Status 404 returned error can't find the container with id 8859f870dbe929bf2b582d60825b44eaafa957540e9e363249ff8958d14b06d2
Nov 02 14:00:01.157131 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.157092    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"]
Nov 02 14:00:01.158266 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:01.158238    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8c17a4_0eab_420d_9d21_90bf56768a59.slice/crio-a8967bbc572b9f7350e09ad44df5447c978559a9c2c91810bce0ed0d551a5e82 WatchSource:0}: Error finding container a8967bbc572b9f7350e09ad44df5447c978559a9c2c91810bce0ed0d551a5e82: Status 404 returned error can't find the container with id a8967bbc572b9f7350e09ad44df5447c978559a9c2c91810bce0ed0d551a5e82
Nov 02 14:00:01.312535 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.312497    5453 generic.go:356] "Generic (PLEG): container finished" podID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerID="00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9" exitCode=0
Nov 02 14:00:01.312727 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.312594    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" event={"ID":"e06e2fae-c590-42e1-854d-b30c9232dac8","Type":"ContainerDied","Data":"00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9"}
Nov 02 14:00:01.312727 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.312663    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js" event={"ID":"e06e2fae-c590-42e1-854d-b30c9232dac8","Type":"ContainerDied","Data":"a1a7000dcdda450420ba0b508e884a4d56e05fcab521cc48e49ffe1f70e1a55a"}
Nov 02 14:00:01.312727 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.312699    5453 scope.go:122] "RemoveContainer" containerID="00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9"
Nov 02 14:00:01.312966 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.312934    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"
Nov 02 14:00:01.315412 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.315314    5453 generic.go:356] "Generic (PLEG): container finished" podID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerID="b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c" exitCode=0
Nov 02 14:00:01.315777 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.315437    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" event={"ID":"36f97e8c-874a-43b3-ab70-10d2984d41a6","Type":"ContainerDied","Data":"b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c"}
Nov 02 14:00:01.315777 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.315489    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr" event={"ID":"36f97e8c-874a-43b3-ab70-10d2984d41a6","Type":"ContainerDied","Data":"768c8d07dd6ab3ef07b75eedfb30392c9fc00178783a6837129459c2c77edc9e"}
Nov 02 14:00:01.315777 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.315580    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"
Nov 02 14:00:01.318975 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.318941    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp" event={"ID":"fd52a1bb-8e49-4fd4-b245-e6056ffa66cb","Type":"ContainerDied","Data":"24c32b2c386f02b88c167e239595cdc9dc1e1d61d32cc8f8f627f0e8b0773e12"}
Nov 02 14:00:01.319126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.319105    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"
Nov 02 14:00:01.323092 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.323039    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj" event={"ID":"3c8c17a4-0eab-420d-9d21-90bf56768a59","Type":"ContainerStarted","Data":"a8967bbc572b9f7350e09ad44df5447c978559a9c2c91810bce0ed0d551a5e82"}
Nov 02 14:00:01.325024 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.324998    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974" event={"ID":"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee","Type":"ContainerStarted","Data":"8859f870dbe929bf2b582d60825b44eaafa957540e9e363249ff8958d14b06d2"}
Nov 02 14:00:01.330009 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.329989    5453 scope.go:122] "RemoveContainer" containerID="00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9"
Nov 02 14:00:01.330421 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:01.330401    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9\": container with ID starting with 00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9 not found: ID does not exist" containerID="00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9"
Nov 02 14:00:01.330472 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.330432    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9"} err="failed to get container status \"00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9\": rpc error: code = NotFound desc = could not find container \"00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9\": container with ID starting with 00b57cd9d75e3bd7be13a26da6747e17f7dc09e9a73007ce615dc3d3f88bfaf9 not found: ID does not exist"
Nov 02 14:00:01.330472 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.330454    5453 scope.go:122] "RemoveContainer" containerID="b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c"
Nov 02 14:00:01.344916 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.344887    5453 scope.go:122] "RemoveContainer" containerID="b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c"
Nov 02 14:00:01.345359 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:01.345328    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c\": container with ID starting with b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c not found: ID does not exist" containerID="b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c"
Nov 02 14:00:01.345619 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.345560    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c"} err="failed to get container status \"b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c\": rpc error: code = NotFound desc = could not find container \"b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c\": container with ID starting with b68263a29f8971542e8d834f566727a13b5dc6a08a58d8ec7bce8dd3750df29c not found: ID does not exist"
Nov 02 14:00:01.345619 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.345598    5453 scope.go:122] "RemoveContainer" containerID="a7f5cdd8fc43c62a049241828b98291445e300546c84e8f17414f5db415c3cc2"
Nov 02 14:00:01.361535 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.361501    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"]
Nov 02 14:00:01.367232 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.367200    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-mz6js"]
Nov 02 14:00:01.386191 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.386060    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"]
Nov 02 14:00:01.401395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.401357    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-8sdzr"]
Nov 02 14:00:01.423584 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.423495    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"]
Nov 02 14:00:01.433213 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.433177    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-1eb567-6466f4b8d7-vwqfp"]
Nov 02 14:00:01.798442 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.798397    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"]
Nov 02 14:00:01.798952 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.798918    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f" podUID="4ea8950d-16b5-44f0-9eb5-ce3ce4500537" containerName="maas-api" containerID="cri-o://30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927" gracePeriod=30
Nov 02 14:00:01.885919 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.885887    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"]
Nov 02 14:00:01.903477 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.903426    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"]
Nov 02 14:00:01.905637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.905609    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:01.925323 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:01.925287    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"]
Nov 02 14:00:02.101258 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.100981    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"]
Nov 02 14:00:02.113018 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.101517    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct" podUID="17c50d12-5f0d-422a-8469-1e72ef7301e8" containerName="maas-api" containerID="cri-o://7bd36ea304d20ed73a5dfc2c76213e9c00c216a90eff8d13f6b03f2a01c91231" gracePeriod=30
Nov 02 14:00:02.150841 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.148383    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:02.150841 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.148569    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"]
Nov 02 14:00:02.279940 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.279855    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:02.400116 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.397741    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 14:00:02.589519 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.579977    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-kube-api-access-jv6nb\" (UniqueName: \"kubernetes.io/projected/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-kube-api-access-jv6nb\") pod \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") "
Nov 02 14:00:02.589519 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.580105    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-metrics-certs\") pod \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") "
Nov 02 14:00:02.589519 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.580250    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-openshift-service-ca\") pod \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") "
Nov 02 14:00:02.589519 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.580319    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-maas-api-tls\") pod \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\" (UID: \"4ea8950d-16b5-44f0-9eb5-ce3ce4500537\") "
Nov 02 14:00:02.800952 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.690759    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-maas-api-tls" pod "4ea8950d-16b5-44f0-9eb5-ce3ce4500537" (UID: "4ea8950d-16b5-44f0-9eb5-ce3ce4500537"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:02.800952 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.777833    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-openshift-service-ca" pod "4ea8950d-16b5-44f0-9eb5-ce3ce4500537" (UID: "4ea8950d-16b5-44f0-9eb5-ce3ce4500537"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:02.800952 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.778020    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"]
Nov 02 14:00:02.840855 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.814201    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-maas-api-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:02.841336 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.841159    5453 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-openshift-service-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:02.880102 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.877430    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-metrics-certs" pod "4ea8950d-16b5-44f0-9eb5-ce3ce4500537" (UID: "4ea8950d-16b5-44f0-9eb5-ce3ce4500537"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:02.915771 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.915730    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:02.971094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.963158    5453 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-metrics-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:02.990340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:02.990295    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-kube-api-access-jv6nb" pod "4ea8950d-16b5-44f0-9eb5-ce3ce4500537" (UID: "4ea8950d-16b5-44f0-9eb5-ce3ce4500537"). InnerVolumeSpecName "kube-api-access-jv6nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:03.178362 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.178276    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 14:00:03.189857 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.189819    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv6nb\" (UniqueName: \"kubernetes.io/projected/4ea8950d-16b5-44f0-9eb5-ce3ce4500537-kube-api-access-jv6nb\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:03.201573 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.200611    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" path="/var/lib/kubelet/pods/36f97e8c-874a-43b3-ab70-10d2984d41a6/volumes"
Nov 02 14:00:03.201573 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.201453    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" path="/var/lib/kubelet/pods/e06e2fae-c590-42e1-854d-b30c9232dac8/volumes"
Nov 02 14:00:03.202028 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.202006    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" path="/var/lib/kubelet/pods/fd52a1bb-8e49-4fd4-b245-e6056ffa66cb/volumes"
Nov 02 14:00:03.204470 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.203186    5453 generic.go:356] "Generic (PLEG): container finished" podID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerID="01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5" exitCode=60
Nov 02 14:00:03.204934 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.204906    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj" event={"ID":"3c8c17a4-0eab-420d-9d21-90bf56768a59","Type":"ContainerDied","Data":"01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5"}
Nov 02 14:00:03.205460 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.205438    5453 scope.go:122] "RemoveContainer" containerID="01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5"
Nov 02 14:00:03.218824 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.218789    5453 generic.go:356] "Generic (PLEG): container finished" podID="4ea8950d-16b5-44f0-9eb5-ce3ce4500537" containerID="30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927" exitCode=0
Nov 02 14:00:03.228191 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.226599    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"
Nov 02 14:00:03.233513 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.227986    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f" event={"ID":"4ea8950d-16b5-44f0-9eb5-ce3ce4500537","Type":"ContainerDied","Data":"30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927"}
Nov 02 14:00:03.233828 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.233795    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f" event={"ID":"4ea8950d-16b5-44f0-9eb5-ce3ce4500537","Type":"ContainerDied","Data":"ffed5f6946ef863f182ca0ddc44167d9c67eb15ffb57378b42d881a979704e0b"}
Nov 02 14:00:03.233956 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.233941    5453 scope.go:122] "RemoveContainer" containerID="30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.297508    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17c50d12-5f0d-422a-8469-1e72ef7301e8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c50d12-5f0d-422a-8469-1e72ef7301e8-openshift-service-ca\") pod \"17c50d12-5f0d-422a-8469-1e72ef7301e8\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") "
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.297733    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-maas-api-tls\") pod \"17c50d12-5f0d-422a-8469-1e72ef7301e8\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") "
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.297767    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17c50d12-5f0d-422a-8469-1e72ef7301e8-kube-api-access-6pxvl\" (UniqueName: \"kubernetes.io/projected/17c50d12-5f0d-422a-8469-1e72ef7301e8-kube-api-access-6pxvl\") pod \"17c50d12-5f0d-422a-8469-1e72ef7301e8\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") "
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.297833    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-metrics-certs\") pod \"17c50d12-5f0d-422a-8469-1e72ef7301e8\" (UID: \"17c50d12-5f0d-422a-8469-1e72ef7301e8\") "
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.326943    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"]
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327851    5453 cpu_manager.go:414] "containerMap: removing container" podUID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" containerName="payload-pre-processing"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327873    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" containerName="payload-pre-processing"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327914    5453 cpu_manager.go:414] "containerMap: removing container" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327922    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327946    5453 cpu_manager.go:414] "containerMap: removing container" podUID="4ea8950d-16b5-44f0-9eb5-ce3ce4500537" containerName="maas-api"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327954    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ea8950d-16b5-44f0-9eb5-ce3ce4500537" containerName="maas-api"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327966    5453 cpu_manager.go:414] "containerMap: removing container" podUID="17c50d12-5f0d-422a-8469-1e72ef7301e8" containerName="maas-api"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327973    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17c50d12-5f0d-422a-8469-1e72ef7301e8" containerName="maas-api"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.327995    5453 cpu_manager.go:414] "containerMap: removing container" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.328002    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.328208    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="17c50d12-5f0d-422a-8469-1e72ef7301e8" containerName="maas-api"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.328226    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="e06e2fae-c590-42e1-854d-b30c9232dac8" containerName="istio-proxy"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.328248    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd52a1bb-8e49-4fd4-b245-e6056ffa66cb" containerName="payload-pre-processing"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.328259    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="36f97e8c-874a-43b3-ab70-10d2984d41a6" containerName="istio-proxy"
Nov 02 14:00:03.331395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.328270    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ea8950d-16b5-44f0-9eb5-ce3ce4500537" containerName="maas-api"
Nov 02 14:00:03.370537 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.370487    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17c50d12-5f0d-422a-8469-1e72ef7301e8-openshift-service-ca" pod "17c50d12-5f0d-422a-8469-1e72ef7301e8" (UID: "17c50d12-5f0d-422a-8469-1e72ef7301e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:03.437991 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.419409    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:03.463688 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.463649    5453 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17c50d12-5f0d-422a-8469-1e72ef7301e8-openshift-service-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:03.486251 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.486209    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-maas-api-tls" pod "17c50d12-5f0d-422a-8469-1e72ef7301e8" (UID: "17c50d12-5f0d-422a-8469-1e72ef7301e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:03.506256 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.506206    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" podUID="c2935f3c-7d58-4bc1-a530-574129413527" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 14:00:03.536157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.536116    5453 generic.go:356] "Generic (PLEG): container finished" podID="17c50d12-5f0d-422a-8469-1e72ef7301e8" containerID="7bd36ea304d20ed73a5dfc2c76213e9c00c216a90eff8d13f6b03f2a01c91231" exitCode=0
Nov 02 14:00:03.536621 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.536601    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"
Nov 02 14:00:03.541211 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.541181    5453 generic.go:356] "Generic (PLEG): container finished" podID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerID="30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458" exitCode=6
Nov 02 14:00:03.541766 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.541749    5453 scope.go:122] "RemoveContainer" containerID="30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458"
Nov 02 14:00:03.555682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.555643    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:03.627666 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.627626    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct" event={"ID":"17c50d12-5f0d-422a-8469-1e72ef7301e8","Type":"ContainerDied","Data":"7bd36ea304d20ed73a5dfc2c76213e9c00c216a90eff8d13f6b03f2a01c91231"}
Nov 02 14:00:03.627876 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.627858    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974" event={"ID":"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee","Type":"ContainerDied","Data":"30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458"}
Nov 02 14:00:03.627998 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.627984    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"]
Nov 02 14:00:03.628140 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.628127    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"]
Nov 02 14:00:03.628235 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.628225    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-1eb567-b44f966f5-6bs2f"]
Nov 02 14:00:03.628415 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.628401    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.668342 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.637463    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-maas-api-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:03.671808 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.655041    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17c50d12-5f0d-422a-8469-1e72ef7301e8-kube-api-access-6pxvl" pod "17c50d12-5f0d-422a-8469-1e72ef7301e8" (UID: "17c50d12-5f0d-422a-8469-1e72ef7301e8"). InnerVolumeSpecName "kube-api-access-6pxvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:03.672052 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.664120    5453 scope.go:122] "RemoveContainer" containerID="30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927"
Nov 02 14:00:03.685266 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:03.680568    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927\": container with ID starting with 30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927 not found: ID does not exist" containerID="30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927"
Nov 02 14:00:03.685266 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.680616    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927"} err="failed to get container status \"30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927\": rpc error: code = NotFound desc = could not find container \"30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927\": container with ID starting with 30a56649ee2318e7b947284a8a50ca9dbba63e218e87c09720e33b4bc3050927 not found: ID does not exist"
Nov 02 14:00:03.685266 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.680646    5453 scope.go:122] "RemoveContainer" containerID="7bd36ea304d20ed73a5dfc2c76213e9c00c216a90eff8d13f6b03f2a01c91231"
Nov 02 14:00:03.717114 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.704121    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 14:00:03.757521 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.728272    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-metrics-certs" pod "17c50d12-5f0d-422a-8469-1e72ef7301e8" (UID: "17c50d12-5f0d-422a-8469-1e72ef7301e8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:03.757521 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.731517    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:03.779659 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.779618    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfs4w\" (UniqueName: \"kubernetes.io/projected/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-kube-api-access-sfs4w\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.779995 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.779974    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.780286 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.780265    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.780701 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.780658    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pxvl\" (UniqueName: \"kubernetes.io/projected/17c50d12-5f0d-422a-8469-1e72ef7301e8-kube-api-access-6pxvl\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:03.781788 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.781744    5453 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17c50d12-5f0d-422a-8469-1e72ef7301e8-metrics-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:03.886150 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.886099    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfs4w\" (UniqueName: \"kubernetes.io/projected/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-kube-api-access-sfs4w\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.886360 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.886231    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.886360 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.886325    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.895875 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.894516    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.896276 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.896122    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.915952 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.915921    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfs4w\" (UniqueName: \"kubernetes.io/projected/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-kube-api-access-sfs4w\") pod \"maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:03.951824 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.951714    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:03.969264 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.969206    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"]
Nov 02 14:00:03.976349 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:03.973361    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f2e945-84fc454f4f-696ct"]
Nov 02 14:00:04.097094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.096552    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:04.122556 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.110546    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:04.308997 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.308770    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:04.478478 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.478343    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:04.675020 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.674940    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:04.704893 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.704825    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj" event={"ID":"3c8c17a4-0eab-420d-9d21-90bf56768a59","Type":"ContainerStarted","Data":"9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356"}
Nov 02 14:00:04.705476 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.705421    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerName="cleanup" containerID="cri-o://9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356" gracePeriod=30
Nov 02 14:00:04.724365 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.724323    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerName="cleanup" containerID="cri-o://575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98" gracePeriod=30
Nov 02 14:00:04.777153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.767442    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj" podStartSLOduration=4.767419166 podStartE2EDuration="4.767419166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:04.740887203 +0000 UTC m=+983.822032325" watchObservedRunningTime="2026-11-02 14:00:04.767419166 +0000 UTC m=+983.848564287"
Nov 02 14:00:04.850674 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.850637    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:04.947781 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.947026    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974" podStartSLOduration=4.946988157 podStartE2EDuration="4.946988157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:04.796474376 +0000 UTC m=+983.877619497" watchObservedRunningTime="2026-11-02 14:00:04.946988157 +0000 UTC m=+984.028133281"
Nov 02 14:00:04.950499 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:04.950459    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"]
Nov 02 14:00:04.971633 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:04.971599    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc05808_0f5c_4d7d_9dc0_2a4242cac93d.slice/crio-1dd5bb80885f08b53142ae931a13a2e74ef40dc80446fda263b1ca0897eb5e0a WatchSource:0}: Error finding container 1dd5bb80885f08b53142ae931a13a2e74ef40dc80446fda263b1ca0897eb5e0a: Status 404 returned error can't find the container with id 1dd5bb80885f08b53142ae931a13a2e74ef40dc80446fda263b1ca0897eb5e0a
Nov 02 14:00:05.031604 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.031567    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:05.060043 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.059457    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17c50d12-5f0d-422a-8469-1e72ef7301e8" path="/var/lib/kubelet/pods/17c50d12-5f0d-422a-8469-1e72ef7301e8/volumes"
Nov 02 14:00:05.060862 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.060435    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ea8950d-16b5-44f0-9eb5-ce3ce4500537" path="/var/lib/kubelet/pods/4ea8950d-16b5-44f0-9eb5-ce3ce4500537/volumes"
Nov 02 14:00:05.475123 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.474828    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:05.617747 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.617649    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-maas-api-service-ca\") pod \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") "
Nov 02 14:00:05.617920 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.617753    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-kube-api-access-7kst9\" (UniqueName: \"kubernetes.io/projected/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-kube-api-access-7kst9\") pod \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\" (UID: \"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee\") "
Nov 02 14:00:05.618084 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.618035    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-maas-api-service-ca" pod "7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" (UID: "7138e706-fb6e-4c40-9a48-b6f8f5cc25ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:05.618365 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.618346    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-maas-api-service-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:05.620427 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.620399    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-kube-api-access-7kst9" pod "7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" (UID: "7138e706-fb6e-4c40-9a48-b6f8f5cc25ee"). InnerVolumeSpecName "kube-api-access-7kst9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:05.732970 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.732398    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kst9\" (UniqueName: \"kubernetes.io/projected/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee-kube-api-access-7kst9\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:05.745223 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.745187    5453 generic.go:356] "Generic (PLEG): container finished" podID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerID="575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98" exitCode=6
Nov 02 14:00:05.745421 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.745258    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"
Nov 02 14:00:05.745421 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.745252    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974" event={"ID":"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee","Type":"ContainerDied","Data":"575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98"}
Nov 02 14:00:05.745790 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.745760    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974" event={"ID":"7138e706-fb6e-4c40-9a48-b6f8f5cc25ee","Type":"ContainerDied","Data":"8859f870dbe929bf2b582d60825b44eaafa957540e9e363249ff8958d14b06d2"}
Nov 02 14:00:05.745921 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.745822    5453 scope.go:122] "RemoveContainer" containerID="575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98"
Nov 02 14:00:05.748123 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.747998    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx" event={"ID":"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d","Type":"ContainerStarted","Data":"5c458cfd0888fefa2c5b4dcc17a5e07ee82551905177e8943cc69d94de07e5a6"}
Nov 02 14:00:05.748123 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.748053    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx" event={"ID":"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d","Type":"ContainerStarted","Data":"1dd5bb80885f08b53142ae931a13a2e74ef40dc80446fda263b1ca0897eb5e0a"}
Nov 02 14:00:05.760858 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.760821    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:05.761270 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.761198    5453 scope.go:122] "RemoveContainer" containerID="30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458"
Nov 02 14:00:05.772599 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.772550    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx" podStartSLOduration=2.77250829 podStartE2EDuration="2.77250829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:05.770919202 +0000 UTC m=+984.852064322" watchObservedRunningTime="2026-11-02 14:00:05.77250829 +0000 UTC m=+984.853653409"
Nov 02 14:00:05.780268 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.780240    5453 scope.go:122] "RemoveContainer" containerID="575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98"
Nov 02 14:00:05.780755 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:05.780720    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98\": container with ID starting with 575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98 not found: ID does not exist" containerID="575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98"
Nov 02 14:00:05.780839 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.780773    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98"} err="failed to get container status \"575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98\": rpc error: code = NotFound desc = could not find container \"575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98\": container with ID starting with 575914d75e3d08e0e3588533ba03fb2614ed0650bdd7adcc93bb5f7014acac98 not found: ID does not exist"
Nov 02 14:00:05.780839 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.780803    5453 scope.go:122] "RemoveContainer" containerID="30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458"
Nov 02 14:00:05.781464 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:05.781425    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458\": container with ID starting with 30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458 not found: ID does not exist" containerID="30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458"
Nov 02 14:00:05.781571 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.781473    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458"} err="failed to get container status \"30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458\": rpc error: code = NotFound desc = could not find container \"30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458\": container with ID starting with 30f09328d4df0f18d8a972a80adc7883694744396ffdef39db815f7ef0b2d458 not found: ID does not exist"
Nov 02 14:00:05.790347 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.790311    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"]
Nov 02 14:00:05.797208 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.797168    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f2e945-29893800-9p974"]
Nov 02 14:00:05.909718 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:05.909135    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:06.089915 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:06.089871    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:00:06.173434 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.173328    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"]
Nov 02 14:00:06.174222 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.174197    5453 cpu_manager.go:414] "containerMap: removing container" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerName="cleanup"
Nov 02 14:00:06.174401 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.174379    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerName="cleanup"
Nov 02 14:00:06.174514 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.174415    5453 cpu_manager.go:414] "containerMap: removing container" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerName="cleanup"
Nov 02 14:00:06.174514 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.174423    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerName="cleanup"
Nov 02 14:00:06.175284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.174633    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerName="cleanup"
Nov 02 14:00:06.175284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.174646    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" containerName="cleanup"
Nov 02 14:00:06.178811 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.178783    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.184441 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.184403    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"]
Nov 02 14:00:06.241802 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.241766    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.241960 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.241829    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.242021 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.241960    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9b6\" (UniqueName: \"kubernetes.io/projected/293cffaa-141f-4002-98ec-e12c0e7a7fbd-kube-api-access-tz9b6\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.343844 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.343790    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.344047 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.343870    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.344047 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.343935    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9b6\" (UniqueName: \"kubernetes.io/projected/293cffaa-141f-4002-98ec-e12c0e7a7fbd-kube-api-access-tz9b6\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.345101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.345014    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.347515 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.347469    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.358968 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.358931    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9b6\" (UniqueName: \"kubernetes.io/projected/293cffaa-141f-4002-98ec-e12c0e7a7fbd-kube-api-access-tz9b6\") pod \"maas-api-revoke-sub-18be6031-zcpks\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.505850 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.505757    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:06.770192 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.770043    5453 generic.go:356] "Generic (PLEG): container finished" podID="4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" containerID="5c458cfd0888fefa2c5b4dcc17a5e07ee82551905177e8943cc69d94de07e5a6" exitCode=0
Nov 02 14:00:06.770192 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.770129    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx" event={"ID":"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d","Type":"ContainerDied","Data":"5c458cfd0888fefa2c5b4dcc17a5e07ee82551905177e8943cc69d94de07e5a6"}
Nov 02 14:00:06.816794 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:06.816754    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"]
Nov 02 14:00:06.817300 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:06.817268    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293cffaa_141f_4002_98ec_e12c0e7a7fbd.slice/crio-383bb5af293a76feee5b0f8b2a901899e52dd09bce7d5f81926e2aa8b19401a5 WatchSource:0}: Error finding container 383bb5af293a76feee5b0f8b2a901899e52dd09bce7d5f81926e2aa8b19401a5: Status 404 returned error can't find the container with id 383bb5af293a76feee5b0f8b2a901899e52dd09bce7d5f81926e2aa8b19401a5
Nov 02 14:00:07.059591 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.059546    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7138e706-fb6e-4c40-9a48-b6f8f5cc25ee" path="/var/lib/kubelet/pods/7138e706-fb6e-4c40-9a48-b6f8f5cc25ee/volumes"
Nov 02 14:00:07.086027 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.085977    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:07.395990 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.395821    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:07.514374 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.514332    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"]
Nov 02 14:00:07.518511 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.518481    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"]
Nov 02 14:00:07.539794 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.539747    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"]
Nov 02 14:00:07.559707 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.559672    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:07.709157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.705534    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:07.828439 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.828329    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks" event={"ID":"293cffaa-141f-4002-98ec-e12c0e7a7fbd","Type":"ContainerStarted","Data":"db4608bd91d0b58cdba1bc70f272f16ac97c8bc0e49391a0f0bd239d99e5652f"}
Nov 02 14:00:07.828439 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.828392    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks" event={"ID":"293cffaa-141f-4002-98ec-e12c0e7a7fbd","Type":"ContainerStarted","Data":"383bb5af293a76feee5b0f8b2a901899e52dd09bce7d5f81926e2aa8b19401a5"}
Nov 02 14:00:07.859998 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:07.859352    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks" podStartSLOduration=1.8593291650000001 podStartE2EDuration="1.859329165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:07.848138877 +0000 UTC m=+986.929284058" watchObservedRunningTime="2026-11-02 14:00:07.859329165 +0000 UTC m=+986.940474286"
Nov 02 14:00:08.159216 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.159187    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:08.222135 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.222004    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-kube-api-access-sfs4w\" (UniqueName: \"kubernetes.io/projected/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-kube-api-access-sfs4w\") pod \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") "
Nov 02 14:00:08.222306 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.222172    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-xks-ca\") pod \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") "
Nov 02 14:00:08.222306 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.222272    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-openshift-ca\") pod \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\" (UID: \"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d\") "
Nov 02 14:00:08.223552 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.223515    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-openshift-ca" pod "4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" (UID: "4fc05808-0f5c-4d7d-9dc0-2a4242cac93d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:08.225323 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.225283    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-xks-ca" pod "4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" (UID: "4fc05808-0f5c-4d7d-9dc0-2a4242cac93d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:08.225323 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.225301    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-kube-api-access-sfs4w" pod "4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" (UID: "4fc05808-0f5c-4d7d-9dc0-2a4242cac93d"). InnerVolumeSpecName "kube-api-access-sfs4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:08.312943 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.312911    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:08.329141 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.324440    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfs4w\" (UniqueName: \"kubernetes.io/projected/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-kube-api-access-sfs4w\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:08.329141 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.324486    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-xks-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:08.329141 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.324501    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d-maas-api-openshift-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:08.836190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.836153    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx" event={"ID":"4fc05808-0f5c-4d7d-9dc0-2a4242cac93d","Type":"ContainerDied","Data":"1dd5bb80885f08b53142ae931a13a2e74ef40dc80446fda263b1ca0897eb5e0a"}
Nov 02 14:00:08.836662 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.836214    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dd5bb80885f08b53142ae931a13a2e74ef40dc80446fda263b1ca0897eb5e0a"
Nov 02 14:00:08.836662 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.836166    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"
Nov 02 14:00:08.838331 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.838299    5453 generic.go:356] "Generic (PLEG): container finished" podID="293cffaa-141f-4002-98ec-e12c0e7a7fbd" containerID="db4608bd91d0b58cdba1bc70f272f16ac97c8bc0e49391a0f0bd239d99e5652f" exitCode=0
Nov 02 14:00:08.838483 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:08.838392    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks" event={"ID":"293cffaa-141f-4002-98ec-e12c0e7a7fbd","Type":"ContainerDied","Data":"db4608bd91d0b58cdba1bc70f272f16ac97c8bc0e49391a0f0bd239d99e5652f"}
Nov 02 14:00:09.430615 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:09.430570    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:10.034648 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.034622    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:10.069744 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.069699    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"]
Nov 02 14:00:10.070570 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.070547    5453 cpu_manager.go:414] "containerMap: removing container" podUID="293cffaa-141f-4002-98ec-e12c0e7a7fbd" containerName="revoke-keys"
Nov 02 14:00:10.070685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.070573    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="293cffaa-141f-4002-98ec-e12c0e7a7fbd" containerName="revoke-keys"
Nov 02 14:00:10.070685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.070621    5453 cpu_manager.go:414] "containerMap: removing container" podUID="4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" containerName="revoke-keys"
Nov 02 14:00:10.070685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.070629    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" containerName="revoke-keys"
Nov 02 14:00:10.070787 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.070760    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="293cffaa-141f-4002-98ec-e12c0e7a7fbd" containerName="revoke-keys"
Nov 02 14:00:10.070787 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.070779    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" containerName="revoke-keys"
Nov 02 14:00:10.074952 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.074766    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.093587 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.093552    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"]
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.168795    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-xks-ca\") pod \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") "
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.168984    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/293cffaa-141f-4002-98ec-e12c0e7a7fbd-kube-api-access-tz9b6\" (UniqueName: \"kubernetes.io/projected/293cffaa-141f-4002-98ec-e12c0e7a7fbd-kube-api-access-tz9b6\") pod \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") "
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.169176    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-openshift-ca\") pod \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\" (UID: \"293cffaa-141f-4002-98ec-e12c0e7a7fbd\") "
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.169585    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.169657    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.169777    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddkk\" (UniqueName: \"kubernetes.io/projected/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-kube-api-access-wddkk\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.170634    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-openshift-ca" pod "293cffaa-141f-4002-98ec-e12c0e7a7fbd" (UID: "293cffaa-141f-4002-98ec-e12c0e7a7fbd"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:10.174126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.173425    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-xks-ca" pod "293cffaa-141f-4002-98ec-e12c0e7a7fbd" (UID: "293cffaa-141f-4002-98ec-e12c0e7a7fbd"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:10.174721 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.174541    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/293cffaa-141f-4002-98ec-e12c0e7a7fbd-kube-api-access-tz9b6" pod "293cffaa-141f-4002-98ec-e12c0e7a7fbd" (UID: "293cffaa-141f-4002-98ec-e12c0e7a7fbd"). InnerVolumeSpecName "kube-api-access-tz9b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:10.272728 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.271511    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.272728 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.271598    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.272728 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.272674    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.273595 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.273162    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddkk\" (UniqueName: \"kubernetes.io/projected/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-kube-api-access-wddkk\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.273748 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.273672    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-openshift-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:10.273821 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.273793    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/293cffaa-141f-4002-98ec-e12c0e7a7fbd-maas-api-xks-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:10.273878 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.273816    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz9b6\" (UniqueName: \"kubernetes.io/projected/293cffaa-141f-4002-98ec-e12c0e7a7fbd-kube-api-access-tz9b6\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:10.276504 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.276478    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.286386 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.286356    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddkk\" (UniqueName: \"kubernetes.io/projected/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-kube-api-access-wddkk\") pod \"maas-api-revoke-sub-36626402-qhdjm\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.410235 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.410137    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:10.451129 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.449831    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:10.629426 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.629391    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:10.732467 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.732431    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"]
Nov 02 14:00:10.732985 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:10.732956    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee81f3f_e736_47e6_88c7_cb0bbc7019eb.slice/crio-beb10d7d5d0f5527f7aa1796f8356d6e81bc352dd6344468c8885c38e6d95452 WatchSource:0}: Error finding container beb10d7d5d0f5527f7aa1796f8356d6e81bc352dd6344468c8885c38e6d95452: Status 404 returned error can't find the container with id beb10d7d5d0f5527f7aa1796f8356d6e81bc352dd6344468c8885c38e6d95452
Nov 02 14:00:10.822112 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.819582    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"]
Nov 02 14:00:10.822112 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.819892    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" containerID="cri-o://e375e269703b4f7a73253013e585dfff4e4562a2f9576b52bf67da6908e341a6" gracePeriod=30
Nov 02 14:00:10.826483 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.825133    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"]
Nov 02 14:00:10.826483 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.825431    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" containerID="cri-o://1bf042ec812b36507d9f7adecf80e4fbed76f36478d4cb2ec4465e19b2c2a2e4" gracePeriod=30
Nov 02 14:00:10.841321 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.840450    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"]
Nov 02 14:00:10.841881 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.841844    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" containerID="cri-o://c696ef4e0cc46d26e4376b692ce20a2622f9915d7af74fb49d5b78dfcb605062" gracePeriod=30
Nov 02 14:00:10.866113 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.866024    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm" event={"ID":"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb","Type":"ContainerStarted","Data":"beb10d7d5d0f5527f7aa1796f8356d6e81bc352dd6344468c8885c38e6d95452"}
Nov 02 14:00:10.869015 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.868987    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks" event={"ID":"293cffaa-141f-4002-98ec-e12c0e7a7fbd","Type":"ContainerDied","Data":"383bb5af293a76feee5b0f8b2a901899e52dd09bce7d5f81926e2aa8b19401a5"}
Nov 02 14:00:10.869234 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.869223    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="383bb5af293a76feee5b0f8b2a901899e52dd09bce7d5f81926e2aa8b19401a5"
Nov 02 14:00:10.869355 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.869347    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"
Nov 02 14:00:10.926809 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:10.926775    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:11.447166 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.442635    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:11.601095 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.600257    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:11.750147 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.749681    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:11.900092 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.899703    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:11.912014 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.911971    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm" event={"ID":"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb","Type":"ContainerStarted","Data":"94a07f60927e9d761ebbb2f3c39823cadc9660a75c5ce59e6771f5bb641240ca"}
Nov 02 14:00:11.917129 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.916199    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"]
Nov 02 14:00:11.921270 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.921233    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:11.927217 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.927162    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 02 14:00:11.927458 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.927420    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 02 14:00:11.928345 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.928320    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 02 14:00:11.934122 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.932130    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kmsk4\""
Nov 02 14:00:11.942156 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.942046    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"]
Nov 02 14:00:11.943889 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:11.943835    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm" podStartSLOduration=1.943819902 podStartE2EDuration="1.943819902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:11.93879043 +0000 UTC m=+991.019935561" watchObservedRunningTime="2026-11-02 14:00:11.943819902 +0000 UTC m=+991.024965076"
Nov 02 14:00:12.059618 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.059558    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.059826 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.059720    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.059826 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.059773    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.059949 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.059839    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.060190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.060026    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.073860 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.073820    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6ksj\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-kube-api-access-k6ksj\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.074041 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.073935    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.079196 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.079153    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"]
Nov 02 14:00:12.080224 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.080043    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" containerID="cri-o://03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60" gracePeriod=30
Nov 02 14:00:12.088352 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.088319    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"]
Nov 02 14:00:12.088606 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.088563    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy" containerID="cri-o://a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0" gracePeriod=30
Nov 02 14:00:12.096965 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.096913    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"]
Nov 02 14:00:12.097589 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.097543    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" containerID="cri-o://3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463" gracePeriod=30
Nov 02 14:00:12.149383 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.149347    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:12.176094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.175546    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.176094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.175622    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.176094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.175687    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.176094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.175822    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.176094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.175859    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6ksj\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-kube-api-access-k6ksj\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.176094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.175921    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.176094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.176003    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.177695 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.177631    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.179274 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.179234    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.179452 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.179428    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.180607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.180581    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.180783 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.180766    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.191707 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.191667    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.200102 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.198943    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6ksj\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-kube-api-access-k6ksj\") pod \"istiod-openshift-gateway-7ddd9cfdc8-6f99s\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.249357 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.248363    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:12.314183 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.313159    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:12.314183 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.313299    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:12.628215 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.628180    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"]
Nov 02 14:00:12.628699 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:12.628278    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7ec0fc_6a95_4380_9cdc_6aa71a6d88bb.slice/crio-78c47b28459742067afe5f01c42dc2e5447d059cf8f8732d53f2aba0040119d5 WatchSource:0}: Error finding container 78c47b28459742067afe5f01c42dc2e5447d059cf8f8732d53f2aba0040119d5: Status 404 returned error can't find the container with id 78c47b28459742067afe5f01c42dc2e5447d059cf8f8732d53f2aba0040119d5
Nov 02 14:00:12.937235 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.936425    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s" event={"ID":"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb","Type":"ContainerStarted","Data":"78c47b28459742067afe5f01c42dc2e5447d059cf8f8732d53f2aba0040119d5"}
Nov 02 14:00:12.943155 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.943053    5453 generic.go:356] "Generic (PLEG): container finished" podID="2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" containerID="94a07f60927e9d761ebbb2f3c39823cadc9660a75c5ce59e6771f5bb641240ca" exitCode=0
Nov 02 14:00:12.943342 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:12.943115    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm" event={"ID":"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb","Type":"ContainerDied","Data":"94a07f60927e9d761ebbb2f3c39823cadc9660a75c5ce59e6771f5bb641240ca"}
Nov 02 14:00:13.097214 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.093439    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:13.274391 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.274286    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:13.274675 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.274646    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:13.362815 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.362379    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:13.362815 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.362467    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:13.404107 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.404021    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" podUID="c2935f3c-7d58-4bc1-a530-574129413527" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 02 14:00:13.612459 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.612362    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:13.782095 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:13.775164    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:14.276167 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.275976    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:14.448671 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.448509    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:14.629282 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.627331    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"]
Nov 02 14:00:14.629282 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.627839    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy" containerID="cri-o://a4301f389efbdc68e9d1a624ebbeb22b17faa3bd12fe360b9d72f1454b4f9587" gracePeriod=30
Nov 02 14:00:14.644117 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.639000    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"]
Nov 02 14:00:14.644117 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.641203    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy" containerID="cri-o://7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848" gracePeriod=30
Nov 02 14:00:14.655840 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.646663    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"]
Nov 02 14:00:14.655840 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.646905    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" containerID="cri-o://caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd" gracePeriod=30
Nov 02 14:00:14.683389 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.681571    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:14.849804 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.847278    5453 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:14.849804 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.847360    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:14.872894 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:14.856342    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:15.000205 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.000159    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm" event={"ID":"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb","Type":"ContainerDied","Data":"beb10d7d5d0f5527f7aa1796f8356d6e81bc352dd6344468c8885c38e6d95452"}
Nov 02 14:00:15.000385 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.000263    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="beb10d7d5d0f5527f7aa1796f8356d6e81bc352dd6344468c8885c38e6d95452"
Nov 02 14:00:15.002567 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.002235    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:15.006817 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.006776    5453 generic.go:356] "Generic (PLEG): container finished" podID="c2935f3c-7d58-4bc1-a530-574129413527" containerID="86f3fb81054763333155d2f88e02e995f2d19c07038734745d32a91b441e88d1" exitCode=0
Nov 02 14:00:15.007000 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.006936    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" event={"ID":"c2935f3c-7d58-4bc1-a530-574129413527","Type":"ContainerDied","Data":"86f3fb81054763333155d2f88e02e995f2d19c07038734745d32a91b441e88d1"}
Nov 02 14:00:15.036110 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.035426    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:15.048096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.045645    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-xks-ca\") pod \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") "
Nov 02 14:00:15.048096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.045771    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-openshift-ca\") pod \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") "
Nov 02 14:00:15.048096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.045885    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-kube-api-access-wddkk\" (UniqueName: \"kubernetes.io/projected/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-kube-api-access-wddkk\") pod \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\" (UID: \"2ee81f3f-e736-47e6-88c7-cb0bbc7019eb\") "
Nov 02 14:00:15.071301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.071214    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-openshift-ca" pod "2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" (UID: "2ee81f3f-e736-47e6-88c7-cb0bbc7019eb"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:15.102876 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.102823    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-kube-api-access-wddkk" pod "2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" (UID: "2ee81f3f-e736-47e6-88c7-cb0bbc7019eb"). InnerVolumeSpecName "kube-api-access-wddkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:15.104285 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.104241    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-xks-ca" pod "2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" (UID: "2ee81f3f-e736-47e6-88c7-cb0bbc7019eb"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:15.104456 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.104311    5453 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:15.104638 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.104444    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:15.127724 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.126530    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 14:00:15.152389 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.152342    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2935f3c-7d58-4bc1-a530-574129413527-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2935f3c-7d58-4bc1-a530-574129413527-plugins-config-volume\") pod \"c2935f3c-7d58-4bc1-a530-574129413527\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") "
Nov 02 14:00:15.152575 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.152531    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2935f3c-7d58-4bc1-a530-574129413527-kube-api-access-xhcf4\" (UniqueName: \"kubernetes.io/projected/c2935f3c-7d58-4bc1-a530-574129413527-kube-api-access-xhcf4\") pod \"c2935f3c-7d58-4bc1-a530-574129413527\" (UID: \"c2935f3c-7d58-4bc1-a530-574129413527\") "
Nov 02 14:00:15.154284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.153432    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-xks-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:15.154284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.153462    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-maas-api-openshift-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:15.154284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.153478    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wddkk\" (UniqueName: \"kubernetes.io/projected/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb-kube-api-access-wddkk\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:15.158502 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.158472    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2935f3c-7d58-4bc1-a530-574129413527-kube-api-access-xhcf4" pod "c2935f3c-7d58-4bc1-a530-574129413527" (UID: "c2935f3c-7d58-4bc1-a530-574129413527"). InnerVolumeSpecName "kube-api-access-xhcf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:15.158841 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.158816    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2935f3c-7d58-4bc1-a530-574129413527-plugins-config-volume" pod "c2935f3c-7d58-4bc1-a530-574129413527" (UID: "c2935f3c-7d58-4bc1-a530-574129413527"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:15.171962 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.171924    5453 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:15.172183 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.172009    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:15.255369 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.255270    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhcf4\" (UniqueName: \"kubernetes.io/projected/c2935f3c-7d58-4bc1-a530-574129413527-kube-api-access-xhcf4\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:15.255369 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:15.255308    5453 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2935f3c-7d58-4bc1-a530-574129413527-plugins-config-volume\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.052676 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.052619    5453 generic.go:356] "Generic (PLEG): container finished" podID="33967ffd-9513-4320-9979-d9b362980e39" containerID="c696ef4e0cc46d26e4376b692ce20a2622f9915d7af74fb49d5b78dfcb605062" exitCode=0
Nov 02 14:00:16.053043 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.052773    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" event={"ID":"33967ffd-9513-4320-9979-d9b362980e39","Type":"ContainerDied","Data":"c696ef4e0cc46d26e4376b692ce20a2622f9915d7af74fb49d5b78dfcb605062"}
Nov 02 14:00:16.084102 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.083995    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4" event={"ID":"c2935f3c-7d58-4bc1-a530-574129413527","Type":"ContainerDied","Data":"3794097ddf32c7068bf77c6ebe666e61288fd981ccf1648d4c9fac5f2d9afc30"}
Nov 02 14:00:16.084277 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.084152    5453 scope.go:122] "RemoveContainer" containerID="86f3fb81054763333155d2f88e02e995f2d19c07038734745d32a91b441e88d1"
Nov 02 14:00:16.084598 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.084576    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"
Nov 02 14:00:16.095518 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.095280    5453 generic.go:356] "Generic (PLEG): container finished" podID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerID="1bf042ec812b36507d9f7adecf80e4fbed76f36478d4cb2ec4465e19b2c2a2e4" exitCode=0
Nov 02 14:00:16.095518 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.095417    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" event={"ID":"0927ad0d-be5d-40a9-9ba0-5369ba0388c0","Type":"ContainerDied","Data":"1bf042ec812b36507d9f7adecf80e4fbed76f36478d4cb2ec4465e19b2c2a2e4"}
Nov 02 14:00:16.098674 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.097139    5453 generic.go:356] "Generic (PLEG): container finished" podID="ad735154-4a32-4029-b513-9e7fcd82be60" containerID="e375e269703b4f7a73253013e585dfff4e4562a2f9576b52bf67da6908e341a6" exitCode=0
Nov 02 14:00:16.098674 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.097280    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"
Nov 02 14:00:16.098674 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.098450    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" event={"ID":"ad735154-4a32-4029-b513-9e7fcd82be60","Type":"ContainerDied","Data":"e375e269703b4f7a73253013e585dfff4e4562a2f9576b52bf67da6908e341a6"}
Nov 02 14:00:16.133431 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.133364    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"]
Nov 02 14:00:16.141615 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.141570    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-f2e945-fb6c85bbc-7hqz4"]
Nov 02 14:00:16.211451 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.211417    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 14:00:16.264366 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.264334    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:16.281108 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.271524    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.288874    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-kube-api-access-hw2lw\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-kube-api-access-hw2lw\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.288977    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-certs\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.289099    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-istio-token\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-istio-token\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.289186    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/33967ffd-9513-4320-9979-d9b362980e39-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33967ffd-9513-4320-9979-d9b362980e39-istio-podinfo\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.289248    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-credential-socket\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.289303    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33967ffd-9513-4320-9979-d9b362980e39-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33967ffd-9513-4320-9979-d9b362980e39-istiod-ca-cert\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.289360    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-envoy\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.289451    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-socket\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.289528    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-data\") pod \"33967ffd-9513-4320-9979-d9b362980e39\" (UID: \"33967ffd-9513-4320-9979-d9b362980e39\") "
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.290655    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-data" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.295575    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-credential-socket" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.296034    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-certs" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.308416    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-envoy" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.308846    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33967ffd-9513-4320-9979-d9b362980e39-istiod-ca-cert" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:16.309261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.309153    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-socket" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.336539 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.330938    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-istio-token" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:16.336539 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.331027    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33967ffd-9513-4320-9979-d9b362980e39-istio-podinfo" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:16.340589 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.340539    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-kube-api-access-hw2lw" pod "33967ffd-9513-4320-9979-d9b362980e39" (UID: "33967ffd-9513-4320-9979-d9b362980e39"). InnerVolumeSpecName "kube-api-access-hw2lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:16.376341 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.376301    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 14:00:16.391736 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.391695    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-socket\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.391920 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.391780    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-certs\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.391920 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.391840    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-kube-api-access-mn6mx\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-kube-api-access-mn6mx\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.391920 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.391867    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-credential-socket\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.391920 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.391892    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-istio-token\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-istio-token\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.392180 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.391962    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad735154-4a32-4029-b513-9e7fcd82be60-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad735154-4a32-4029-b513-9e7fcd82be60-istio-podinfo\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.392180 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392004    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-envoy\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.392180 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392047    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad735154-4a32-4029-b513-9e7fcd82be60-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad735154-4a32-4029-b513-9e7fcd82be60-istiod-ca-cert\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.392340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392186    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-data\") pod \"ad735154-4a32-4029-b513-9e7fcd82be60\" (UID: \"ad735154-4a32-4029-b513-9e7fcd82be60\") "
Nov 02 14:00:16.392885 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392861    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392889    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392905    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33967ffd-9513-4320-9979-d9b362980e39-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392920    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392934    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33967ffd-9513-4320-9979-d9b362980e39-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392946    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392960    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392974    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33967ffd-9513-4320-9979-d9b362980e39-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.392992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.392987    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw2lw\" (UniqueName: \"kubernetes.io/projected/33967ffd-9513-4320-9979-d9b362980e39-kube-api-access-hw2lw\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.393720 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.393627    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-credential-socket" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.393891 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.393866    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-socket" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.394237 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.394041    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-data" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.394775 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.394742    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-certs" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.395033 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.395000    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad735154-4a32-4029-b513-9e7fcd82be60-istiod-ca-cert" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:16.397384 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.397350    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-envoy" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.397502 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.397389    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad735154-4a32-4029-b513-9e7fcd82be60-istio-podinfo" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:16.398622 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.398593    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-istio-token" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:16.399180 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.399152    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-kube-api-access-mn6mx" pod "ad735154-4a32-4029-b513-9e7fcd82be60" (UID: "ad735154-4a32-4029-b513-9e7fcd82be60"). InnerVolumeSpecName "kube-api-access-mn6mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:16.493570 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.493526    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-podinfo\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.493770 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.493580    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-envoy\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.493770 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.493636    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-data\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.493770 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.493661    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-credential-socket\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.493770 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.493698    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-socket\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.493986 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.493781    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istiod-ca-cert\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.493986 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.493923    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-kube-api-access-2cm48\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-kube-api-access-2cm48\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.494103 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.494039    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-token\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-token\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.494155 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.494139    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-certs\") pod \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\" (UID: \"0927ad0d-be5d-40a9-9ba0-5369ba0388c0\") "
Nov 02 14:00:16.494216 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.494137    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-data" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.494459 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.494338    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-credential-socket" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.494638 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.494561    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-socket" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.494788 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.494579    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-certs" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.494905 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.494817    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istiod-ca-cert" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495010    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495032    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495045    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495060    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn6mx\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-kube-api-access-mn6mx\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495096    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495110    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad735154-4a32-4029-b513-9e7fcd82be60-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495121    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495135    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495147    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad735154-4a32-4029-b513-9e7fcd82be60-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495158    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495171    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495182    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad735154-4a32-4029-b513-9e7fcd82be60-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495196    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.495368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.495207    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad735154-4a32-4029-b513-9e7fcd82be60-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.499270 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.499232    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-podinfo" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:16.499270 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.499253    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-envoy" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:16.499424 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.499309    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-kube-api-access-2cm48" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "kube-api-access-2cm48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:16.500856 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.500827    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-token" pod "0927ad0d-be5d-40a9-9ba0-5369ba0388c0" (UID: "0927ad0d-be5d-40a9-9ba0-5369ba0388c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:16.503042 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503013    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"]
Nov 02 14:00:16.503719 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503700    5453 cpu_manager.go:414] "containerMap: removing container" podUID="2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" containerName="revoke-keys"
Nov 02 14:00:16.503719 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503719    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" containerName="revoke-keys"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503737    5453 cpu_manager.go:414] "containerMap: removing container" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503742    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503759    5453 cpu_manager.go:414] "containerMap: removing container" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503764    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503780    5453 cpu_manager.go:414] "containerMap: removing container" podUID="c2935f3c-7d58-4bc1-a530-574129413527" containerName="payload-processing"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503786    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2935f3c-7d58-4bc1-a530-574129413527" containerName="payload-processing"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503808    5453 cpu_manager.go:414] "containerMap: removing container" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy"
Nov 02 14:00:16.503873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503813    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy"
Nov 02 14:00:16.504340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503900    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="33967ffd-9513-4320-9979-d9b362980e39" containerName="istio-proxy"
Nov 02 14:00:16.504340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503910    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" containerName="istio-proxy"
Nov 02 14:00:16.504340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503918    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2935f3c-7d58-4bc1-a530-574129413527" containerName="payload-processing"
Nov 02 14:00:16.504340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503926    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" containerName="istio-proxy"
Nov 02 14:00:16.504340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.503933    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" containerName="revoke-keys"
Nov 02 14:00:16.511701 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.511670    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.516252 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.516224    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 02 14:00:16.518188 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.518109    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"]
Nov 02 14:00:16.596724 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.596633    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1631553c-ce05-4029-892e-75dbc340e016-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.596904 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.596811    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1631553c-ce05-4029-892e-75dbc340e016-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.596904 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.596864    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtvxg\" (UniqueName: \"kubernetes.io/projected/1631553c-ce05-4029-892e-75dbc340e016-kube-api-access-wtvxg\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.597043 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.597006    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cm48\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-kube-api-access-2cm48\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.597043 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.597024    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.597043 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.597040    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.597200 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.597049    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0927ad0d-be5d-40a9-9ba0-5369ba0388c0-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:16.699261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.699198    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1631553c-ce05-4029-892e-75dbc340e016-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.699462 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.699314    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtvxg\" (UniqueName: \"kubernetes.io/projected/1631553c-ce05-4029-892e-75dbc340e016-kube-api-access-wtvxg\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.699520 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.699472    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1631553c-ce05-4029-892e-75dbc340e016-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.700224 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.700172    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1631553c-ce05-4029-892e-75dbc340e016-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.702873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.702847    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1631553c-ce05-4029-892e-75dbc340e016-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.713559 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.713529    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtvxg\" (UniqueName: \"kubernetes.io/projected/1631553c-ce05-4029-892e-75dbc340e016-kube-api-access-wtvxg\") pod \"maas-api-revoke-sub-a99d0aa5-75njr\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.836612 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.836573    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:16.924486 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.924111    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" containerID="cri-o://030e951976c0203cdeaf6f9b00d87e6197adca7897ffa69b85d8d0220a420b27" gracePeriod=45
Nov 02 14:00:16.953951 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.953295    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main" containerID="cri-o://4710a5f40254a7a8bcfd60a8d7d4890df58e49d3839ab69cea3f3f07408579e3" gracePeriod=45
Nov 02 14:00:16.976147 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:16.975917    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" containerID="cri-o://afe9fa0e88916867bec9f67b5c950d6c2d4f4c9f01537e4de6b08c945eed73fa" gracePeriod=45
Nov 02 14:00:17.010671 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.010634    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"]
Nov 02 14:00:17.016129 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.016100    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.031466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.031428    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"]
Nov 02 14:00:17.050114 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.050060    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2935f3c-7d58-4bc1-a530-574129413527" path="/var/lib/kubelet/pods/c2935f3c-7d58-4bc1-a530-574129413527/volumes"
Nov 02 14:00:17.109990 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.109929    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszbf\" (UniqueName: \"kubernetes.io/projected/c54e457a-219b-4a84-a32a-8e255dc83cc2-kube-api-access-qszbf\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.110916 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.110889    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.111460 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.111441    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.133934 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.133794    5453 generic.go:356] "Generic (PLEG): container finished" podID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerID="4710a5f40254a7a8bcfd60a8d7d4890df58e49d3839ab69cea3f3f07408579e3" exitCode=0
Nov 02 14:00:17.133934 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.133886    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" event={"ID":"e2ffe821-d125-4899-926e-395d1fe2fa95","Type":"ContainerDied","Data":"4710a5f40254a7a8bcfd60a8d7d4890df58e49d3839ab69cea3f3f07408579e3"}
Nov 02 14:00:17.139261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.136255    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv" event={"ID":"33967ffd-9513-4320-9979-d9b362980e39","Type":"ContainerDied","Data":"41b61a3de957082d851a20a89cebfa7e7f33033c441084937db9615d41000620"}
Nov 02 14:00:17.139261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.136332    5453 scope.go:122] "RemoveContainer" containerID="c696ef4e0cc46d26e4376b692ce20a2622f9915d7af74fb49d5b78dfcb605062"
Nov 02 14:00:17.139261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.136464    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"
Nov 02 14:00:17.154801 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.154413    5453 generic.go:356] "Generic (PLEG): container finished" podID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerID="afe9fa0e88916867bec9f67b5c950d6c2d4f4c9f01537e4de6b08c945eed73fa" exitCode=0
Nov 02 14:00:17.154801 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.154625    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" event={"ID":"2f2e3ba0-8157-491c-985f-272f60c674a8","Type":"ContainerDied","Data":"afe9fa0e88916867bec9f67b5c950d6c2d4f4c9f01537e4de6b08c945eed73fa"}
Nov 02 14:00:17.163541 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.161766    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm" event={"ID":"0927ad0d-be5d-40a9-9ba0-5369ba0388c0","Type":"ContainerDied","Data":"9aa7fca3e72effb4378725a6fdb44e65bbe3a9f632aded4e78d5f5b5ee76d79e"}
Nov 02 14:00:17.163541 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.161914    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"
Nov 02 14:00:17.195469 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.186508    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"]
Nov 02 14:00:17.196560 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.196520    5453 generic.go:356] "Generic (PLEG): container finished" podID="a105dea4-399c-49a9-aacc-72f443e80de2" containerID="030e951976c0203cdeaf6f9b00d87e6197adca7897ffa69b85d8d0220a420b27" exitCode=0
Nov 02 14:00:17.196703 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.196665    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" event={"ID":"a105dea4-399c-49a9-aacc-72f443e80de2","Type":"ContainerDied","Data":"030e951976c0203cdeaf6f9b00d87e6197adca7897ffa69b85d8d0220a420b27"}
Nov 02 14:00:17.200124 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.200038    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw" event={"ID":"ad735154-4a32-4029-b513-9e7fcd82be60","Type":"ContainerDied","Data":"380e90c2476c4a60cc65d01add982ad87815ffa6fc97fd7368926d782445abe0"}
Nov 02 14:00:17.201426 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.200372    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"
Nov 02 14:00:17.213963 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.213539    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszbf\" (UniqueName: \"kubernetes.io/projected/c54e457a-219b-4a84-a32a-8e255dc83cc2-kube-api-access-qszbf\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.213963 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.213732    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.213963 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.213772    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.214878 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.214851    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.222877 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.222787    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main" probeResult="failure" output="Get \"https://10.133.0.71:8000/ready\": dial tcp 10.133.0.71:8000: connect: connection refused"
Nov 02 14:00:17.222877 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.222838    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.263681 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:17.257652    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1631553c_ce05_4029_892e_75dbc340e016.slice/crio-587f66e11707cd9d6e0dc67dd17109eb165c2f5d81eb1e8ca9fd30993e39b03b WatchSource:0}: Error finding container 587f66e11707cd9d6e0dc67dd17109eb165c2f5d81eb1e8ca9fd30993e39b03b: Status 404 returned error can't find the container with id 587f66e11707cd9d6e0dc67dd17109eb165c2f5d81eb1e8ca9fd30993e39b03b
Nov 02 14:00:17.285696 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.273596    5453 scope.go:122] "RemoveContainer" containerID="1bf042ec812b36507d9f7adecf80e4fbed76f36478d4cb2ec4465e19b2c2a2e4"
Nov 02 14:00:17.285696 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.276231    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszbf\" (UniqueName: \"kubernetes.io/projected/c54e457a-219b-4a84-a32a-8e255dc83cc2-kube-api-access-qszbf\") pod \"maas-api-revoke-sub-46575c20-fpcpm\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.362662 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.362222    5453 scope.go:122] "RemoveContainer" containerID="e375e269703b4f7a73253013e585dfff4e4562a2f9576b52bf67da6908e341a6"
Nov 02 14:00:17.373733 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.373275    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"]
Nov 02 14:00:17.377137 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.377113    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-bh9nv"]
Nov 02 14:00:17.417000 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.416296    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"]
Nov 02 14:00:17.444467 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.444410    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-g24lm"]
Nov 02 14:00:17.444933 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.444915    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:17.467544 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.467511    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"]
Nov 02 14:00:17.479881 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.473364    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 14:00:17.480207 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.480189    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-8mnsw"]
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.540778    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-home\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-home\") pod \"e2ffe821-d125-4899-926e-395d1fe2fa95\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") "
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.540916    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-dshm\") pod \"e2ffe821-d125-4899-926e-395d1fe2fa95\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") "
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.541144    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-model-cache\") pod \"e2ffe821-d125-4899-926e-395d1fe2fa95\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") "
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.541188    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e2ffe821-d125-4899-926e-395d1fe2fa95-tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ffe821-d125-4899-926e-395d1fe2fa95-tls-certs\") pod \"e2ffe821-d125-4899-926e-395d1fe2fa95\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") "
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.541238    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-tmp-dir\") pod \"e2ffe821-d125-4899-926e-395d1fe2fa95\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") "
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.541286    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2ffe821-d125-4899-926e-395d1fe2fa95-kube-api-access-ls22n\" (UniqueName: \"kubernetes.io/projected/e2ffe821-d125-4899-926e-395d1fe2fa95-kube-api-access-ls22n\") pod \"e2ffe821-d125-4899-926e-395d1fe2fa95\" (UID: \"e2ffe821-d125-4899-926e-395d1fe2fa95\") "
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.547921    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.548231    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-model-cache" pod "e2ffe821-d125-4899-926e-395d1fe2fa95" (UID: "e2ffe821-d125-4899-926e-395d1fe2fa95"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.552091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.548743    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-home" pod "e2ffe821-d125-4899-926e-395d1fe2fa95" (UID: "e2ffe821-d125-4899-926e-395d1fe2fa95"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.557500 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.553925    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-dshm" pod "e2ffe821-d125-4899-926e-395d1fe2fa95" (UID: "e2ffe821-d125-4899-926e-395d1fe2fa95"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.557500 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.554724    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-tmp-dir" pod "e2ffe821-d125-4899-926e-395d1fe2fa95" (UID: "e2ffe821-d125-4899-926e-395d1fe2fa95"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.562653 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.562583    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ffe821-d125-4899-926e-395d1fe2fa95-kube-api-access-ls22n" pod "e2ffe821-d125-4899-926e-395d1fe2fa95" (UID: "e2ffe821-d125-4899-926e-395d1fe2fa95"). InnerVolumeSpecName "kube-api-access-ls22n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.563949 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.563890    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2ffe821-d125-4899-926e-395d1fe2fa95-tls-certs" pod "e2ffe821-d125-4899-926e-395d1fe2fa95" (UID: "e2ffe821-d125-4899-926e-395d1fe2fa95"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:17.585157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.584600    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 14:00:17.597635 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.597541    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 14:00:17.647460 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.647420    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-dshm\") pod \"2f2e3ba0-8157-491c-985f-272f60c674a8\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") "
Nov 02 14:00:17.648960 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.647527    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f2e3ba0-8157-491c-985f-272f60c674a8-tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2e3ba0-8157-491c-985f-272f60c674a8-tls-certs\") pod \"2f2e3ba0-8157-491c-985f-272f60c674a8\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") "
Nov 02 14:00:17.648960 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.647577    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-home\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-home\") pod \"2f2e3ba0-8157-491c-985f-272f60c674a8\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") "
Nov 02 14:00:17.648960 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.647609    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-tmp-dir\") pod \"2f2e3ba0-8157-491c-985f-272f60c674a8\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") "
Nov 02 14:00:17.659465 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.659153    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-tmp-dir" pod "2f2e3ba0-8157-491c-985f-272f60c674a8" (UID: "2f2e3ba0-8157-491c-985f-272f60c674a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.659465 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.659180    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f2e3ba0-8157-491c-985f-272f60c674a8-kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/2f2e3ba0-8157-491c-985f-272f60c674a8-kube-api-access-4pdgl\") pod \"2f2e3ba0-8157-491c-985f-272f60c674a8\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") "
Nov 02 14:00:17.659465 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.659333    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-model-cache\") pod \"2f2e3ba0-8157-491c-985f-272f60c674a8\" (UID: \"2f2e3ba0-8157-491c-985f-272f60c674a8\") "
Nov 02 14:00:17.660234 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.660191    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-model-cache" pod "2f2e3ba0-8157-491c-985f-272f60c674a8" (UID: "2f2e3ba0-8157-491c-985f-272f60c674a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.663745 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.663712    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664009 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.663971    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664165 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.664152    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664293 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.664281    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664409 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.664395    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664568 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.664500    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2ffe821-d125-4899-926e-395d1fe2fa95-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664568 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.664516    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2ffe821-d125-4899-926e-395d1fe2fa95-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664568 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.664533    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls22n\" (UniqueName: \"kubernetes.io/projected/e2ffe821-d125-4899-926e-395d1fe2fa95-kube-api-access-ls22n\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.664936 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.664189    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-home" pod "2f2e3ba0-8157-491c-985f-272f60c674a8" (UID: "2f2e3ba0-8157-491c-985f-272f60c674a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.672895 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.672431    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 14:00:17.676397 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.676343    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2e3ba0-8157-491c-985f-272f60c674a8-kube-api-access-4pdgl" pod "2f2e3ba0-8157-491c-985f-272f60c674a8" (UID: "2f2e3ba0-8157-491c-985f-272f60c674a8"). InnerVolumeSpecName "kube-api-access-4pdgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.677163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.677057    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f2e3ba0-8157-491c-985f-272f60c674a8-tls-certs" pod "2f2e3ba0-8157-491c-985f-272f60c674a8" (UID: "2f2e3ba0-8157-491c-985f-272f60c674a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:17.679924 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.679854    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-dshm" pod "2f2e3ba0-8157-491c-985f-272f60c674a8" (UID: "2f2e3ba0-8157-491c-985f-272f60c674a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.757181 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.757061    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 14:00:17.765209 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.765050    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a105dea4-399c-49a9-aacc-72f443e80de2-kube-api-access-t8hwc\" (UniqueName: \"kubernetes.io/projected/a105dea4-399c-49a9-aacc-72f443e80de2-kube-api-access-t8hwc\") pod \"a105dea4-399c-49a9-aacc-72f443e80de2\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") "
Nov 02 14:00:17.765209 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.765150    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-tmp-dir\") pod \"a105dea4-399c-49a9-aacc-72f443e80de2\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") "
Nov 02 14:00:17.766256 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.765865    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-tmp-dir" pod "a105dea4-399c-49a9-aacc-72f443e80de2" (UID: "a105dea4-399c-49a9-aacc-72f443e80de2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766450    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-dshm\") pod \"a105dea4-399c-49a9-aacc-72f443e80de2\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766491    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-token\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-token\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766556    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-socket\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766623    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-envoy\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766682    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/105ffa58-e906-4ad5-b587-cf3245cc1c03-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/105ffa58-e906-4ad5-b587-cf3245cc1c03-istiod-ca-cert\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766758    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-podinfo\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766789    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-kube-api-access-kcnnt\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-kube-api-access-kcnnt\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766888    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-model-cache\") pod \"a105dea4-399c-49a9-aacc-72f443e80de2\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.766949    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-certs\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767006    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a105dea4-399c-49a9-aacc-72f443e80de2-tls-certs\" (UniqueName: \"kubernetes.io/secret/a105dea4-399c-49a9-aacc-72f443e80de2-tls-certs\") pod \"a105dea4-399c-49a9-aacc-72f443e80de2\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767045    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-credential-socket\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767115    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-data\") pod \"105ffa58-e906-4ad5-b587-cf3245cc1c03\" (UID: \"105ffa58-e906-4ad5-b587-cf3245cc1c03\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767121    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-socket" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767166    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-home\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-home\") pod \"a105dea4-399c-49a9-aacc-72f443e80de2\" (UID: \"a105dea4-399c-49a9-aacc-72f443e80de2\") "
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767482    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-model-cache" pod "a105dea4-399c-49a9-aacc-72f443e80de2" (UID: "a105dea4-399c-49a9-aacc-72f443e80de2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767781    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/105ffa58-e906-4ad5-b587-cf3245cc1c03-istiod-ca-cert" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767885    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767910    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767925    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767939    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f2e3ba0-8157-491c-985f-272f60c674a8-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767951    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f2e3ba0-8157-491c-985f-272f60c674a8-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767966    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pdgl\" (UniqueName: \"kubernetes.io/projected/2f2e3ba0-8157-491c-985f-272f60c674a8-kube-api-access-4pdgl\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.768225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.767981    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.770295 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.769887    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-certs" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.770295 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.769972    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a105dea4-399c-49a9-aacc-72f443e80de2-kube-api-access-t8hwc" pod "a105dea4-399c-49a9-aacc-72f443e80de2" (UID: "a105dea4-399c-49a9-aacc-72f443e80de2"). InnerVolumeSpecName "kube-api-access-t8hwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.770497 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.770382    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-data" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.770961 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.770606    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-credential-socket" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.770961 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.770802    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-podinfo" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:17.771238 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.771056    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-home" pod "a105dea4-399c-49a9-aacc-72f443e80de2" (UID: "a105dea4-399c-49a9-aacc-72f443e80de2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.771238 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.763613    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 14:00:17.771485 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.771461    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-token" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.771564 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.771541    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-envoy" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.775664 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.775550    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a105dea4-399c-49a9-aacc-72f443e80de2-tls-certs" pod "a105dea4-399c-49a9-aacc-72f443e80de2" (UID: "a105dea4-399c-49a9-aacc-72f443e80de2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:17.817231 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.817162    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-dshm" pod "a105dea4-399c-49a9-aacc-72f443e80de2" (UID: "a105dea4-399c-49a9-aacc-72f443e80de2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.821502 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.821437    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-kube-api-access-kcnnt" pod "105ffa58-e906-4ad5-b587-cf3245cc1c03" (UID: "105ffa58-e906-4ad5-b587-cf3245cc1c03"). InnerVolumeSpecName "kube-api-access-kcnnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869184    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-kube-api-access-4clb2\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-kube-api-access-4clb2\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869263    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-data\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869290    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-podinfo\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869325    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-podinfo\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869365    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-credential-socket\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869416    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-envoy\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869444    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-data\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869500    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-credential-socket\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869533    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-kube-api-access-2mqj6\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-kube-api-access-2mqj6\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869566    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-socket\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869606    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-token\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-token\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869661    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-certs\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869700    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0361eb54-8d3a-4522-8d65-176c37a4aa24-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0361eb54-8d3a-4522-8d65-176c37a4aa24-istiod-ca-cert\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869731    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-socket\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869789    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-certs\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869869    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-token\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-token\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869930    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-envoy\") pod \"0361eb54-8d3a-4522-8d65-176c37a4aa24\" (UID: \"0361eb54-8d3a-4522-8d65-176c37a4aa24\") "
Nov 02 14:00:17.870600 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.869975    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/119b10e2-6c1b-42de-a168-8348caafd4d6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119b10e2-6c1b-42de-a168-8348caafd4d6-istiod-ca-cert\") pod \"119b10e2-6c1b-42de-a168-8348caafd4d6\" (UID: \"119b10e2-6c1b-42de-a168-8348caafd4d6\") "
Nov 02 14:00:17.873051 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.872095    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873051 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.872138    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a105dea4-399c-49a9-aacc-72f443e80de2-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873051 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.872153    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873051 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.872168    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873051 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.872183    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873051 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.872202    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8hwc\" (UniqueName: \"kubernetes.io/projected/a105dea4-399c-49a9-aacc-72f443e80de2-kube-api-access-t8hwc\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.873563    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a105dea4-399c-49a9-aacc-72f443e80de2-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.873607    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.873618    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.873627    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/105ffa58-e906-4ad5-b587-cf3245cc1c03-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.873637    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/105ffa58-e906-4ad5-b587-cf3245cc1c03-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.873886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.873648    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcnnt\" (UniqueName: \"kubernetes.io/projected/105ffa58-e906-4ad5-b587-cf3245cc1c03-kube-api-access-kcnnt\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.874361 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.874278    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-data" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.874659 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.874628    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119b10e2-6c1b-42de-a168-8348caafd4d6-istiod-ca-cert" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:17.875126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.875050    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-certs" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.875472 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.875448    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0361eb54-8d3a-4522-8d65-176c37a4aa24-istiod-ca-cert" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:17.875787 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.875763    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-socket" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.875989 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.875968    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-certs" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.877779 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.877054    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-data" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.877779 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.877240    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-credential-socket" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.877779 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.877433    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-socket" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.877779 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.877748    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-credential-socket" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.884967 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.884790    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-podinfo" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:17.886572 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.885964    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-kube-api-access-4clb2" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "kube-api-access-4clb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.888013 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.887230    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-podinfo" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:17.888013 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.887365    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-token" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.888013 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.887949    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-token" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.888691 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.888635    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-envoy" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.889876 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.889834    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-kube-api-access-2mqj6" pod "0361eb54-8d3a-4522-8d65-176c37a4aa24" (UID: "0361eb54-8d3a-4522-8d65-176c37a4aa24"). InnerVolumeSpecName "kube-api-access-2mqj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:17.890974 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.890944    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-envoy" pod "119b10e2-6c1b-42de-a168-8348caafd4d6" (UID: "119b10e2-6c1b-42de-a168-8348caafd4d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990206    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4clb2\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-kube-api-access-4clb2\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990248    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990262    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990275    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990289    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990302    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990315    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990328    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990341    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mqj6\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-kube-api-access-2mqj6\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990354    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990367    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990380    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990393    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0361eb54-8d3a-4522-8d65-176c37a4aa24-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990408    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990421    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119b10e2-6c1b-42de-a168-8348caafd4d6-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990434    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119b10e2-6c1b-42de-a168-8348caafd4d6-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990446    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0361eb54-8d3a-4522-8d65-176c37a4aa24-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:17.990489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:17.990459    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119b10e2-6c1b-42de-a168-8348caafd4d6-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:18.148692 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:00:18.148575    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54e457a_219b_4a84_a32a_8e255dc83cc2.slice/crio-5f87ee8fa8b4c0525b63ade7bd01bbf5103ab6c689a0c08a8638b3bd8e3d7cae WatchSource:0}: Error finding container 5f87ee8fa8b4c0525b63ade7bd01bbf5103ab6c689a0c08a8638b3bd8e3d7cae: Status 404 returned error can't find the container with id 5f87ee8fa8b4c0525b63ade7bd01bbf5103ab6c689a0c08a8638b3bd8e3d7cae
Nov 02 14:00:18.148692 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.148616    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"]
Nov 02 14:00:18.213002 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.212966    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"
Nov 02 14:00:18.213002 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.212974    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk" event={"ID":"a105dea4-399c-49a9-aacc-72f443e80de2","Type":"ContainerDied","Data":"0254e5aefdf41f6639903c0898c679005fdf52f4fff4bb816f388f76bce16c81"}
Nov 02 14:00:18.213277 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.213041    5453 scope.go:122] "RemoveContainer" containerID="030e951976c0203cdeaf6f9b00d87e6197adca7897ffa69b85d8d0220a420b27"
Nov 02 14:00:18.215537 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.215430    5453 generic.go:356] "Generic (PLEG): container finished" podID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerID="a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0" exitCode=0
Nov 02 14:00:18.215537 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.215482    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" event={"ID":"119b10e2-6c1b-42de-a168-8348caafd4d6","Type":"ContainerDied","Data":"a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0"}
Nov 02 14:00:18.215537 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.215502    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"
Nov 02 14:00:18.215762 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.215541    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm" event={"ID":"119b10e2-6c1b-42de-a168-8348caafd4d6","Type":"ContainerDied","Data":"fe7a7ed8a97eab96423b9771ef3ca896ce447d06e40a2dcb6064e8b43e6cca5e"}
Nov 02 14:00:18.227120 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.220382    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr" event={"ID":"1631553c-ce05-4029-892e-75dbc340e016","Type":"ContainerStarted","Data":"957b5e2fa17820e604debdbdfaee6755ff5161fc20d8cfb0f617e306ef882eaf"}
Nov 02 14:00:18.227120 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.220446    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr" event={"ID":"1631553c-ce05-4029-892e-75dbc340e016","Type":"ContainerStarted","Data":"587f66e11707cd9d6e0dc67dd17109eb165c2f5d81eb1e8ca9fd30993e39b03b"}
Nov 02 14:00:18.227933 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.227897    5453 generic.go:356] "Generic (PLEG): container finished" podID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerID="3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463" exitCode=0
Nov 02 14:00:18.228085 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.227966    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"
Nov 02 14:00:18.228085 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.227998    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" event={"ID":"0361eb54-8d3a-4522-8d65-176c37a4aa24","Type":"ContainerDied","Data":"3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463"}
Nov 02 14:00:18.228085 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.228054    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct" event={"ID":"0361eb54-8d3a-4522-8d65-176c37a4aa24","Type":"ContainerDied","Data":"d95556f9750d51d5cd69d0f951274d1e31ecc6481f9ee021c15f142d1bc8f7f3"}
Nov 02 14:00:18.230115 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.230084    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"
Nov 02 14:00:18.230239 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.230152    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb" event={"ID":"e2ffe821-d125-4899-926e-395d1fe2fa95","Type":"ContainerDied","Data":"7533674d3fad45bd4553fb596ade68382c66594b63193426b6e6a6ebe70d64ef"}
Nov 02 14:00:18.235032 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.234996    5453 generic.go:356] "Generic (PLEG): container finished" podID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerID="03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60" exitCode=0
Nov 02 14:00:18.235238 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.235031    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" event={"ID":"105ffa58-e906-4ad5-b587-cf3245cc1c03","Type":"ContainerDied","Data":"03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60"}
Nov 02 14:00:18.235238 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.235082    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"
Nov 02 14:00:18.235238 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.235115    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q" event={"ID":"105ffa58-e906-4ad5-b587-cf3245cc1c03","Type":"ContainerDied","Data":"e747051b7a8980e1bad6849083a7af5d699acf563c38cc358cc4823488b3504f"}
Nov 02 14:00:18.250119 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.244192    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm" event={"ID":"c54e457a-219b-4a84-a32a-8e255dc83cc2","Type":"ContainerStarted","Data":"5f87ee8fa8b4c0525b63ade7bd01bbf5103ab6c689a0c08a8638b3bd8e3d7cae"}
Nov 02 14:00:18.250119 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.248745    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr" podStartSLOduration=2.248724322 podStartE2EDuration="2.248724322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:18.244660439 +0000 UTC m=+997.325805641" watchObservedRunningTime="2026-11-02 14:00:18.248724322 +0000 UTC m=+997.329869448"
Nov 02 14:00:18.257607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.256740    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" event={"ID":"2f2e3ba0-8157-491c-985f-272f60c674a8","Type":"ContainerDied","Data":"dd5615678d94e88233b0ef55ad23f2626d2773d7829d7dfa154ece8695acad54"}
Nov 02 14:00:18.257607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.256848    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"
Nov 02 14:00:18.267008 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.266982    5453 scope.go:122] "RemoveContainer" containerID="a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0"
Nov 02 14:00:18.286497 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.286467    5453 scope.go:122] "RemoveContainer" containerID="a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0"
Nov 02 14:00:18.287626 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:18.287167    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0\": container with ID starting with a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0 not found: ID does not exist" containerID="a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0"
Nov 02 14:00:18.287626 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.287232    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0"} err="failed to get container status \"a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0\": rpc error: code = NotFound desc = could not find container \"a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0\": container with ID starting with a4e56c5b8c3471deb53261698e95d90c1a9fb27c24e326dca4fb65a2a99f3ce0 not found: ID does not exist"
Nov 02 14:00:18.287626 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.287268    5453 scope.go:122] "RemoveContainer" containerID="3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463"
Nov 02 14:00:18.289245 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.289219    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"]
Nov 02 14:00:18.292848 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.292823    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9cwfm"]
Nov 02 14:00:18.302645 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.302623    5453 scope.go:122] "RemoveContainer" containerID="3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463"
Nov 02 14:00:18.303142 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:18.303113    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463\": container with ID starting with 3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463 not found: ID does not exist" containerID="3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463"
Nov 02 14:00:18.303241 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.303151    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463"} err="failed to get container status \"3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463\": rpc error: code = NotFound desc = could not find container \"3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463\": container with ID starting with 3c15f1aac1aeb9b3ce76d6f92d010dcc7bcc605faf53ac88a94a0081b6d2c463 not found: ID does not exist"
Nov 02 14:00:18.303241 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.303171    5453 scope.go:122] "RemoveContainer" containerID="4710a5f40254a7a8bcfd60a8d7d4890df58e49d3839ab69cea3f3f07408579e3"
Nov 02 14:00:18.306636 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.306604    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"]
Nov 02 14:00:18.311668 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.311595    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-b6d7q"]
Nov 02 14:00:18.318817 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.318797    5453 scope.go:122] "RemoveContainer" containerID="03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60"
Nov 02 14:00:18.329887 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.329850    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"]
Nov 02 14:00:18.343998 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.343970    5453 scope.go:122] "RemoveContainer" containerID="03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60"
Nov 02 14:00:18.344614 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:18.344473    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60\": container with ID starting with 03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60 not found: ID does not exist" containerID="03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60"
Nov 02 14:00:18.344614 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.344511    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60"} err="failed to get container status \"03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60\": rpc error: code = NotFound desc = could not find container \"03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60\": container with ID starting with 03cc76fd08a3103987cf04475dade2651bfdd90e233530215ed96939e3cbcd60 not found: ID does not exist"
Nov 02 14:00:18.344614 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.344537    5453 scope.go:122] "RemoveContainer" containerID="afe9fa0e88916867bec9f67b5c950d6c2d4f4c9f01537e4de6b08c945eed73fa"
Nov 02 14:00:18.345594 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.345570    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/premium-w4-9e0c2f-kserve-7b8649c75f-x9knb"]
Nov 02 14:00:18.346050 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.346022    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:00:18.356199 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.356159    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"]
Nov 02 14:00:18.366945 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.366892    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/simulator-w4-9e0c2f-kserve-647c54dfdb-tfjgj"]
Nov 02 14:00:18.378404 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.378360    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"]
Nov 02 14:00:18.387553 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.387520    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-9e0c2f/distinct-w4-9e0c2f-kserve-6d9bb8c5d-nbnbk"]
Nov 02 14:00:18.401257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.401163    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"]
Nov 02 14:00:18.404714 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.404680    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-xv8ct"]
Nov 02 14:00:18.422142 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.422052    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 14:00:18.422308 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.422184    5453 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 02 14:00:18.545674 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:18.545634    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:19.059555 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.059509    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" path="/var/lib/kubelet/pods/0361eb54-8d3a-4522-8d65-176c37a4aa24/volumes"
Nov 02 14:00:19.060226 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.060205    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0927ad0d-be5d-40a9-9ba0-5369ba0388c0" path="/var/lib/kubelet/pods/0927ad0d-be5d-40a9-9ba0-5369ba0388c0/volumes"
Nov 02 14:00:19.060798 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.060778    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" path="/var/lib/kubelet/pods/105ffa58-e906-4ad5-b587-cf3245cc1c03/volumes"
Nov 02 14:00:19.061938 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.061910    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" path="/var/lib/kubelet/pods/119b10e2-6c1b-42de-a168-8348caafd4d6/volumes"
Nov 02 14:00:19.062642 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.062624    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" path="/var/lib/kubelet/pods/2f2e3ba0-8157-491c-985f-272f60c674a8/volumes"
Nov 02 14:00:19.063025 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.063012    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33967ffd-9513-4320-9979-d9b362980e39" path="/var/lib/kubelet/pods/33967ffd-9513-4320-9979-d9b362980e39/volumes"
Nov 02 14:00:19.063735 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.063718    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" path="/var/lib/kubelet/pods/a105dea4-399c-49a9-aacc-72f443e80de2/volumes"
Nov 02 14:00:19.064129 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.064116    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad735154-4a32-4029-b513-9e7fcd82be60" path="/var/lib/kubelet/pods/ad735154-4a32-4029-b513-9e7fcd82be60/volumes"
Nov 02 14:00:19.064490 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.064477    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" path="/var/lib/kubelet/pods/e2ffe821-d125-4899-926e-395d1fe2fa95/volumes"
Nov 02 14:00:19.279633 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.279600    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s" event={"ID":"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb","Type":"ContainerStarted","Data":"8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87"}
Nov 02 14:00:19.280787 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.280745    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:19.285910 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.285858    5453 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-6f99s container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:19.286154 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.286128    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s" podUID="3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:19.287284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.287242    5453 generic.go:356] "Generic (PLEG): container finished" podID="1631553c-ce05-4029-892e-75dbc340e016" containerID="957b5e2fa17820e604debdbdfaee6755ff5161fc20d8cfb0f617e306ef882eaf" exitCode=0
Nov 02 14:00:19.287519 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.287336    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr" event={"ID":"1631553c-ce05-4029-892e-75dbc340e016","Type":"ContainerDied","Data":"957b5e2fa17820e604debdbdfaee6755ff5161fc20d8cfb0f617e306ef882eaf"}
Nov 02 14:00:19.294287 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.294248    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm" event={"ID":"c54e457a-219b-4a84-a32a-8e255dc83cc2","Type":"ContainerStarted","Data":"a5c1518104cd9b2e37d197ccf3b684063d3b5291098e740a4dad2ae10c633ad8"}
Nov 02 14:00:19.306330 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.306250    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s" podStartSLOduration=2.5161482790000003 podStartE2EDuration="8.306230663s" totalImagesPullingTime="5.790082384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:19.304115733 +0000 UTC m=+998.385260854" watchObservedRunningTime="2026-11-02 14:00:19.306230663 +0000 UTC m=+998.387375785"
Nov 02 14:00:19.595271 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.595139    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:19.898995 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:19.898959    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:20.067771 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.067016    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:20.121353 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.121241    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 14:00:20.202173 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.201881    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-credential-socket\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.202659 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.202523    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-credential-socket" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.205551 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.205502    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-socket" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.205959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.205934    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-socket\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.209048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.206171    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-certs\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.209048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.206235    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-token\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-token\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.209048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.206273    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/664674d2-5544-48f2-a75e-6dd5e48ea244-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664674d2-5544-48f2-a75e-6dd5e48ea244-istiod-ca-cert\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.209048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.206351    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-data\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.209048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.206415    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-podinfo\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.209048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.206455    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-envoy\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.209048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.206612    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-kube-api-access-blrjp\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-kube-api-access-blrjp\") pod \"664674d2-5544-48f2-a75e-6dd5e48ea244\" (UID: \"664674d2-5544-48f2-a75e-6dd5e48ea244\") "
Nov 02 14:00:20.210217 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.209893    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/664674d2-5544-48f2-a75e-6dd5e48ea244-istiod-ca-cert" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:20.210320 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.210215    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-certs" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.210876 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.210500    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-data" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.210876 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.210820    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.210876 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.210843    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.217225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.217182    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-envoy" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.217448 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.217421    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-token" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.229857 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.226723    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-podinfo" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:20.229857 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.228345    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-kube-api-access-blrjp" pod "664674d2-5544-48f2-a75e-6dd5e48ea244" (UID: "664674d2-5544-48f2-a75e-6dd5e48ea244"). InnerVolumeSpecName "kube-api-access-blrjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.238392 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.238356    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 14:00:20.257778 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.257747    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:20.336960 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.336926    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-credential-socket\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.337849 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.337718    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-credential-socket" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.337991 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.337837    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-envoy\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.338153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.338035    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-istio-token\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-istio-token\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.338153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.338115    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-data\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.338849 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.338162    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-socket\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.338849 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.338202    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-certs\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.338849 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.338399    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-data" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.338849 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.338684    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-certs" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.338849 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.338745    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-socket" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.339278 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339050    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64b50361-73ce-4714-8eee-7852ab9d077f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64b50361-73ce-4714-8eee-7852ab9d077f-istio-podinfo\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.339278 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339114    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64b50361-73ce-4714-8eee-7852ab9d077f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64b50361-73ce-4714-8eee-7852ab9d077f-istiod-ca-cert\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.339278 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339177    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-kube-api-access-l5lg6\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-kube-api-access-l5lg6\") pod \"64b50361-73ce-4714-8eee-7852ab9d077f\" (UID: \"64b50361-73ce-4714-8eee-7852ab9d077f\") "
Nov 02 14:00:20.339771 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339751    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.339867 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339775    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blrjp\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-kube-api-access-blrjp\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.339867 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339792    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.339867 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339807    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.339867 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339820    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.339867 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339834    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.339867 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339850    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664674d2-5544-48f2-a75e-6dd5e48ea244-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.339867 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339866    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.340233 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339879    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.340233 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339893    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.340233 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.339906    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664674d2-5544-48f2-a75e-6dd5e48ea244-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.342408 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.340418    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b50361-73ce-4714-8eee-7852ab9d077f-istiod-ca-cert" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:20.342753 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.342680    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-kube-api-access-l5lg6" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "kube-api-access-l5lg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.343917 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.343874    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-istio-token" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.345905 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.345823    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-envoy" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.345905 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.345882    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64b50361-73ce-4714-8eee-7852ab9d077f-istio-podinfo" pod "64b50361-73ce-4714-8eee-7852ab9d077f" (UID: "64b50361-73ce-4714-8eee-7852ab9d077f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:20.356260 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.353472    5453 generic.go:356] "Generic (PLEG): container finished" podID="64b50361-73ce-4714-8eee-7852ab9d077f" containerID="caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd" exitCode=0
Nov 02 14:00:20.356260 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.353654    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" event={"ID":"64b50361-73ce-4714-8eee-7852ab9d077f","Type":"ContainerDied","Data":"caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd"}
Nov 02 14:00:20.356260 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.353718    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n" event={"ID":"64b50361-73ce-4714-8eee-7852ab9d077f","Type":"ContainerDied","Data":"2d5f7c682de91de6242ddfdcc122393e52c5ae0bd0b23ad09bbbd367b19a882e"}
Nov 02 14:00:20.356260 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.353753    5453 scope.go:122] "RemoveContainer" containerID="caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd"
Nov 02 14:00:20.356260 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.353937    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"
Nov 02 14:00:20.385655 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.385217    5453 generic.go:356] "Generic (PLEG): container finished" podID="c54e457a-219b-4a84-a32a-8e255dc83cc2" containerID="a5c1518104cd9b2e37d197ccf3b684063d3b5291098e740a4dad2ae10c633ad8" exitCode=0
Nov 02 14:00:20.385655 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.385440    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm" event={"ID":"c54e457a-219b-4a84-a32a-8e255dc83cc2","Type":"ContainerDied","Data":"a5c1518104cd9b2e37d197ccf3b684063d3b5291098e740a4dad2ae10c633ad8"}
Nov 02 14:00:20.387881 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.387854    5453 generic.go:356] "Generic (PLEG): container finished" podID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerID="7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848" exitCode=0
Nov 02 14:00:20.387989 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.387953    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" event={"ID":"664674d2-5544-48f2-a75e-6dd5e48ea244","Type":"ContainerDied","Data":"7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848"}
Nov 02 14:00:20.388124 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.388003    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6" event={"ID":"664674d2-5544-48f2-a75e-6dd5e48ea244","Type":"ContainerDied","Data":"451e6b1f0d37297959fa180f437cef070992dc1fdbc7ba5ee8af5b344cfd5248"}
Nov 02 14:00:20.388124 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.388118    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"
Nov 02 14:00:20.407368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.396284    5453 generic.go:356] "Generic (PLEG): container finished" podID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerID="a4301f389efbdc68e9d1a624ebbeb22b17faa3bd12fe360b9d72f1454b4f9587" exitCode=0
Nov 02 14:00:20.407368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.396604    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" event={"ID":"b4fa0fe4-2e64-45ba-95d2-b75d67d28688","Type":"ContainerDied","Data":"a4301f389efbdc68e9d1a624ebbeb22b17faa3bd12fe360b9d72f1454b4f9587"}
Nov 02 14:00:20.407368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.398208    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:00:20.414302 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.413619    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"]
Nov 02 14:00:20.427142 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.426523    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8wx6n"]
Nov 02 14:00:20.442190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.440977    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5lg6\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-kube-api-access-l5lg6\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.442190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.441008    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64b50361-73ce-4714-8eee-7852ab9d077f-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.442190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.441025    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64b50361-73ce-4714-8eee-7852ab9d077f-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.442190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.441038    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64b50361-73ce-4714-8eee-7852ab9d077f-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.442190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.441050    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64b50361-73ce-4714-8eee-7852ab9d077f-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.442957 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.442940    5453 scope.go:122] "RemoveContainer" containerID="caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd"
Nov 02 14:00:20.443683 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:20.443540    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd\": container with ID starting with caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd not found: ID does not exist" containerID="caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd"
Nov 02 14:00:20.443683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.443580    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd"} err="failed to get container status \"caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd\": rpc error: code = NotFound desc = could not find container \"caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd\": container with ID starting with caf6901bd89e593d458cfa067064aaaa22ec64640a6cb2ff7fc99689b0ec19fd not found: ID does not exist"
Nov 02 14:00:20.443683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.443604    5453 scope.go:122] "RemoveContainer" containerID="7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848"
Nov 02 14:00:20.444781 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.444756    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"]
Nov 02 14:00:20.468236 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.468194    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-lz6n6"]
Nov 02 14:00:20.501303 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.499295    5453 scope.go:122] "RemoveContainer" containerID="7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848"
Nov 02 14:00:20.501303 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:20.499670    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848\": container with ID starting with 7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848 not found: ID does not exist" containerID="7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848"
Nov 02 14:00:20.501303 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.499697    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848"} err="failed to get container status \"7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848\": rpc error: code = NotFound desc = could not find container \"7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848\": container with ID starting with 7afdccfdeddba3358ce3a31e027c5ff43fa9096c193862f9e905b9a0707be848 not found: ID does not exist"
Nov 02 14:00:20.501303 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.499717    5453 scope.go:122] "RemoveContainer" containerID="8824eec1b0a259272a6f9c34bd92b4e057c47d99d7fd366eacd367a33a552cd7"
Nov 02 14:00:20.657109 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.656629    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 14:00:20.732058 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.732023    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:20.745175 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.745143    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-certs\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.745534 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.745510    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-socket\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.745773 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.745731    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-socket" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.745889 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.745816    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-token\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-token\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.745956 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.745885    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-kube-api-access-spkrb\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-kube-api-access-spkrb\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.746020 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.746005    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-credential-socket\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.746794 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.746211    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-envoy\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.746794 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.746296    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istiod-ca-cert\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.746794 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.746485    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-data\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.746794 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.746736    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-credential-socket" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.747879 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.747136    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-podinfo\") pod \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\" (UID: \"b4fa0fe4-2e64-45ba-95d2-b75d67d28688\") "
Nov 02 14:00:20.747879 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.747593    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istiod-ca-cert" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:20.747879 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.747798    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.747879 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.747822    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.747879 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.747839    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.748251 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.748186    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-data" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.748914 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.748873    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-certs" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.750845 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.750544    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-token" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.750845 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.750676    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:20.752480 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.752449    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-envoy" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:20.755348 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.755316    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-podinfo" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:20.757294 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.757264    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-kube-api-access-spkrb" pod "b4fa0fe4-2e64-45ba-95d2-b75d67d28688" (UID: "b4fa0fe4-2e64-45ba-95d2-b75d67d28688"). InnerVolumeSpecName "kube-api-access-spkrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.831927 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.831877    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.849248    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1631553c-ce05-4029-892e-75dbc340e016-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1631553c-ce05-4029-892e-75dbc340e016-maas-api-openshift-ca\") pod \"1631553c-ce05-4029-892e-75dbc340e016\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") "
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.849320    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-xks-ca\") pod \"c54e457a-219b-4a84-a32a-8e255dc83cc2\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") "
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.849392    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1631553c-ce05-4029-892e-75dbc340e016-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1631553c-ce05-4029-892e-75dbc340e016-maas-api-xks-ca\") pod \"1631553c-ce05-4029-892e-75dbc340e016\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") "
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.849501    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-openshift-ca\") pod \"c54e457a-219b-4a84-a32a-8e255dc83cc2\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") "
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.849549    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1631553c-ce05-4029-892e-75dbc340e016-kube-api-access-wtvxg\" (UniqueName: \"kubernetes.io/projected/1631553c-ce05-4029-892e-75dbc340e016-kube-api-access-wtvxg\") pod \"1631553c-ce05-4029-892e-75dbc340e016\" (UID: \"1631553c-ce05-4029-892e-75dbc340e016\") "
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.849586    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c54e457a-219b-4a84-a32a-8e255dc83cc2-kube-api-access-qszbf\" (UniqueName: \"kubernetes.io/projected/c54e457a-219b-4a84-a32a-8e255dc83cc2-kube-api-access-qszbf\") pod \"c54e457a-219b-4a84-a32a-8e255dc83cc2\" (UID: \"c54e457a-219b-4a84-a32a-8e255dc83cc2\") "
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.850103    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.850124    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.850137    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.850149    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.850161    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.850596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.850173    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spkrb\" (UniqueName: \"kubernetes.io/projected/b4fa0fe4-2e64-45ba-95d2-b75d67d28688-kube-api-access-spkrb\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.853293 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.853260    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-openshift-ca" pod "c54e457a-219b-4a84-a32a-8e255dc83cc2" (UID: "c54e457a-219b-4a84-a32a-8e255dc83cc2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:20.853493 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.853265    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1631553c-ce05-4029-892e-75dbc340e016-maas-api-openshift-ca" pod "1631553c-ce05-4029-892e-75dbc340e016" (UID: "1631553c-ce05-4029-892e-75dbc340e016"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:20.859596 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.859543    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1631553c-ce05-4029-892e-75dbc340e016-kube-api-access-wtvxg" pod "1631553c-ce05-4029-892e-75dbc340e016" (UID: "1631553c-ce05-4029-892e-75dbc340e016"). InnerVolumeSpecName "kube-api-access-wtvxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.859904 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.859874    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54e457a-219b-4a84-a32a-8e255dc83cc2-kube-api-access-qszbf" pod "c54e457a-219b-4a84-a32a-8e255dc83cc2" (UID: "c54e457a-219b-4a84-a32a-8e255dc83cc2"). InnerVolumeSpecName "kube-api-access-qszbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:20.862652 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.862598    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-xks-ca" pod "c54e457a-219b-4a84-a32a-8e255dc83cc2" (UID: "c54e457a-219b-4a84-a32a-8e255dc83cc2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:20.865040 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.864991    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1631553c-ce05-4029-892e-75dbc340e016-maas-api-xks-ca" pod "1631553c-ce05-4029-892e-75dbc340e016" (UID: "1631553c-ce05-4029-892e-75dbc340e016"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:20.951993 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.951905    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1631553c-ce05-4029-892e-75dbc340e016-maas-api-xks-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.951993 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.951942    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-openshift-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.951993 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.951953    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtvxg\" (UniqueName: \"kubernetes.io/projected/1631553c-ce05-4029-892e-75dbc340e016-kube-api-access-wtvxg\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.951993 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.951963    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qszbf\" (UniqueName: \"kubernetes.io/projected/c54e457a-219b-4a84-a32a-8e255dc83cc2-kube-api-access-qszbf\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.951993 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.951972    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1631553c-ce05-4029-892e-75dbc340e016-maas-api-openshift-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:20.951993 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:20.951981    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c54e457a-219b-4a84-a32a-8e255dc83cc2-maas-api-xks-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:21.056563 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.056529    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" path="/var/lib/kubelet/pods/64b50361-73ce-4714-8eee-7852ab9d077f/volumes"
Nov 02 14:00:21.057090 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.057055    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" path="/var/lib/kubelet/pods/664674d2-5544-48f2-a75e-6dd5e48ea244/volumes"
Nov 02 14:00:21.408814 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.408772    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"
Nov 02 14:00:21.409442 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.408766    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm" event={"ID":"c54e457a-219b-4a84-a32a-8e255dc83cc2","Type":"ContainerDied","Data":"5f87ee8fa8b4c0525b63ade7bd01bbf5103ab6c689a0c08a8638b3bd8e3d7cae"}
Nov 02 14:00:21.409609 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.409471    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f87ee8fa8b4c0525b63ade7bd01bbf5103ab6c689a0c08a8638b3bd8e3d7cae"
Nov 02 14:00:21.412692 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.412664    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd" event={"ID":"b4fa0fe4-2e64-45ba-95d2-b75d67d28688","Type":"ContainerDied","Data":"897dfa9d805a7b7d102a77ac64e43148b6d1d6a89a726a6c2a504e1da812936a"}
Nov 02 14:00:21.412873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.412724    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"
Nov 02 14:00:21.412873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.412730    5453 scope.go:122] "RemoveContainer" containerID="a4301f389efbdc68e9d1a624ebbeb22b17faa3bd12fe360b9d72f1454b4f9587"
Nov 02 14:00:21.414461 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.414400    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr" event={"ID":"1631553c-ce05-4029-892e-75dbc340e016","Type":"ContainerDied","Data":"587f66e11707cd9d6e0dc67dd17109eb165c2f5d81eb1e8ca9fd30993e39b03b"}
Nov 02 14:00:21.414461 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.414451    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"
Nov 02 14:00:21.414618 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.414500    5453 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="587f66e11707cd9d6e0dc67dd17109eb165c2f5d81eb1e8ca9fd30993e39b03b"
Nov 02 14:00:21.442922 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.442382    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"]
Nov 02 14:00:21.446984 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.446944    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-8g2zd"]
Nov 02 14:00:21.803649 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:21.803607    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:22.211288 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.211198    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:22.539190 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.539147    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main" containerID="cri-o://59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009" gracePeriod=45
Nov 02 14:00:22.541561 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.541493    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" containerID="cri-o://2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5" gracePeriod=45
Nov 02 14:00:22.554274 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.554234    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": EOF"
Nov 02 14:00:22.572737 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.572690    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" containerID="cri-o://e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315" gracePeriod=45
Nov 02 14:00:22.711403 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.711369    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:22.861590 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.861561    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:22.899450 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.899053    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 14:00:22.952438 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.952409    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 14:00:22.984471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.984425    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-home\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-home\") pod \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") "
Nov 02 14:00:22.985466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.984766    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-kube-api-access-4jfzf\" (UniqueName: \"kubernetes.io/projected/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-kube-api-access-4jfzf\") pod \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") "
Nov 02 14:00:22.985466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.984831    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tls-certs\" (UniqueName: \"kubernetes.io/secret/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tls-certs\") pod \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") "
Nov 02 14:00:22.985466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.984886    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-model-cache\") pod \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") "
Nov 02 14:00:22.986658 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.985767    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tmp-dir\") pod \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") "
Nov 02 14:00:22.986658 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.985848    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-dshm\") pod \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\" (UID: \"3daa95f1-a1f8-4c2e-aab8-b2aee344b247\") "
Nov 02 14:00:22.990988 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.987845    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tmp-dir" pod "3daa95f1-a1f8-4c2e-aab8-b2aee344b247" (UID: "3daa95f1-a1f8-4c2e-aab8-b2aee344b247"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:22.990988 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.989840    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-kube-api-access-4jfzf" pod "3daa95f1-a1f8-4c2e-aab8-b2aee344b247" (UID: "3daa95f1-a1f8-4c2e-aab8-b2aee344b247"). InnerVolumeSpecName "kube-api-access-4jfzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:22.991406 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.991373    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-model-cache" pod "3daa95f1-a1f8-4c2e-aab8-b2aee344b247" (UID: "3daa95f1-a1f8-4c2e-aab8-b2aee344b247"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:22.991501 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.991443    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-home" pod "3daa95f1-a1f8-4c2e-aab8-b2aee344b247" (UID: "3daa95f1-a1f8-4c2e-aab8-b2aee344b247"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:22.992533 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.992508    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tls-certs" pod "3daa95f1-a1f8-4c2e-aab8-b2aee344b247" (UID: "3daa95f1-a1f8-4c2e-aab8-b2aee344b247"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:22.995375 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:22.995331    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-dshm" pod "3daa95f1-a1f8-4c2e-aab8-b2aee344b247" (UID: "3daa95f1-a1f8-4c2e-aab8-b2aee344b247"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.021598 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.021571    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 14:00:23.050048 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.049922    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" path="/var/lib/kubelet/pods/b4fa0fe4-2e64-45ba-95d2-b75d67d28688/volumes"
Nov 02 14:00:23.087007 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.086973    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/231dcfc8-2f20-4320-af69-f0d190e5583a-tls-certs\" (UniqueName: \"kubernetes.io/secret/231dcfc8-2f20-4320-af69-f0d190e5583a-tls-certs\") pod \"231dcfc8-2f20-4320-af69-f0d190e5583a\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") "
Nov 02 14:00:23.087293 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087037    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/231dcfc8-2f20-4320-af69-f0d190e5583a-kube-api-access-j5skv\" (UniqueName: \"kubernetes.io/projected/231dcfc8-2f20-4320-af69-f0d190e5583a-kube-api-access-j5skv\") pod \"231dcfc8-2f20-4320-af69-f0d190e5583a\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") "
Nov 02 14:00:23.087293 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087172    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f419c032-58c1-4b81-809d-25af9d31453e-tls-certs\" (UniqueName: \"kubernetes.io/secret/f419c032-58c1-4b81-809d-25af9d31453e-tls-certs\") pod \"f419c032-58c1-4b81-809d-25af9d31453e\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") "
Nov 02 14:00:23.087293 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087205    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-tmp-dir\") pod \"231dcfc8-2f20-4320-af69-f0d190e5583a\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") "
Nov 02 14:00:23.087466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087292    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-model-cache\") pod \"231dcfc8-2f20-4320-af69-f0d190e5583a\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") "
Nov 02 14:00:23.087466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087352    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-home\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-home\") pod \"231dcfc8-2f20-4320-af69-f0d190e5583a\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") "
Nov 02 14:00:23.087466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087385    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-tmp-dir\") pod \"f419c032-58c1-4b81-809d-25af9d31453e\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") "
Nov 02 14:00:23.087466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087447    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-dshm\") pod \"f419c032-58c1-4b81-809d-25af9d31453e\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") "
Nov 02 14:00:23.087669 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087476    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-dshm\") pod \"231dcfc8-2f20-4320-af69-f0d190e5583a\" (UID: \"231dcfc8-2f20-4320-af69-f0d190e5583a\") "
Nov 02 14:00:23.087669 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087504    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f419c032-58c1-4b81-809d-25af9d31453e-kube-api-access-97ttx\" (UniqueName: \"kubernetes.io/projected/f419c032-58c1-4b81-809d-25af9d31453e-kube-api-access-97ttx\") pod \"f419c032-58c1-4b81-809d-25af9d31453e\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") "
Nov 02 14:00:23.087669 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087529    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-home\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-home\") pod \"f419c032-58c1-4b81-809d-25af9d31453e\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") "
Nov 02 14:00:23.087669 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087590    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-model-cache\") pod \"f419c032-58c1-4b81-809d-25af9d31453e\" (UID: \"f419c032-58c1-4b81-809d-25af9d31453e\") "
Nov 02 14:00:23.087878 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.087705    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-model-cache" pod "231dcfc8-2f20-4320-af69-f0d190e5583a" (UID: "231dcfc8-2f20-4320-af69-f0d190e5583a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.088156 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088132    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.088364 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088348    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.088516 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088498    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.088632 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088619    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.088732 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088719    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jfzf\" (UniqueName: \"kubernetes.io/projected/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-kube-api-access-4jfzf\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.088822 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088810    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.088913 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088902    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3daa95f1-a1f8-4c2e-aab8-b2aee344b247-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.088994 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088675    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-home" pod "231dcfc8-2f20-4320-af69-f0d190e5583a" (UID: "231dcfc8-2f20-4320-af69-f0d190e5583a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.089098 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.088845    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-home" pod "f419c032-58c1-4b81-809d-25af9d31453e" (UID: "f419c032-58c1-4b81-809d-25af9d31453e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.089196 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.089009    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-tmp-dir" pod "f419c032-58c1-4b81-809d-25af9d31453e" (UID: "f419c032-58c1-4b81-809d-25af9d31453e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.089367 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.089327    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-model-cache" pod "f419c032-58c1-4b81-809d-25af9d31453e" (UID: "f419c032-58c1-4b81-809d-25af9d31453e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.090287 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.089925    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-tmp-dir" pod "231dcfc8-2f20-4320-af69-f0d190e5583a" (UID: "231dcfc8-2f20-4320-af69-f0d190e5583a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.093595 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.093563    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231dcfc8-2f20-4320-af69-f0d190e5583a-kube-api-access-j5skv" pod "231dcfc8-2f20-4320-af69-f0d190e5583a" (UID: "231dcfc8-2f20-4320-af69-f0d190e5583a"). InnerVolumeSpecName "kube-api-access-j5skv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:23.093833 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.093801    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231dcfc8-2f20-4320-af69-f0d190e5583a-tls-certs" pod "231dcfc8-2f20-4320-af69-f0d190e5583a" (UID: "231dcfc8-2f20-4320-af69-f0d190e5583a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:23.094611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.094581    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-dshm" pod "f419c032-58c1-4b81-809d-25af9d31453e" (UID: "f419c032-58c1-4b81-809d-25af9d31453e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.094611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.094593    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-dshm" pod "231dcfc8-2f20-4320-af69-f0d190e5583a" (UID: "231dcfc8-2f20-4320-af69-f0d190e5583a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:23.094777 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.094754    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f419c032-58c1-4b81-809d-25af9d31453e-tls-certs" pod "f419c032-58c1-4b81-809d-25af9d31453e" (UID: "f419c032-58c1-4b81-809d-25af9d31453e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:23.096467 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.096439    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f419c032-58c1-4b81-809d-25af9d31453e-kube-api-access-97ttx" pod "f419c032-58c1-4b81-809d-25af9d31453e" (UID: "f419c032-58c1-4b81-809d-25af9d31453e"). InnerVolumeSpecName "kube-api-access-97ttx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:23.190712 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190666    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190712 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190706    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/231dcfc8-2f20-4320-af69-f0d190e5583a-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190712 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190717    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5skv\" (UniqueName: \"kubernetes.io/projected/231dcfc8-2f20-4320-af69-f0d190e5583a-kube-api-access-j5skv\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190728    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f419c032-58c1-4b81-809d-25af9d31453e-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190738    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190746    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190754    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190761    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190768    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/231dcfc8-2f20-4320-af69-f0d190e5583a-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190775    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97ttx\" (UniqueName: \"kubernetes.io/projected/f419c032-58c1-4b81-809d-25af9d31453e-kube-api-access-97ttx\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.190973 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.190783    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f419c032-58c1-4b81-809d-25af9d31453e-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:23.432595 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.432490    5453 generic.go:356] "Generic (PLEG): container finished" podID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerID="59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009" exitCode=0
Nov 02 14:00:23.432595 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.432547    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"
Nov 02 14:00:23.432595 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.432583    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" event={"ID":"3daa95f1-a1f8-4c2e-aab8-b2aee344b247","Type":"ContainerDied","Data":"59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009"}
Nov 02 14:00:23.432917 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.432622    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56" event={"ID":"3daa95f1-a1f8-4c2e-aab8-b2aee344b247","Type":"ContainerDied","Data":"2eff0e27745d4190f864e24d18230a07a9f754677242b61c6537feb116dd7944"}
Nov 02 14:00:23.432917 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.432639    5453 scope.go:122] "RemoveContainer" containerID="59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009"
Nov 02 14:00:23.437265 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.437237    5453 generic.go:356] "Generic (PLEG): container finished" podID="f419c032-58c1-4b81-809d-25af9d31453e" containerID="2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5" exitCode=0
Nov 02 14:00:23.437459 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.437443    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"
Nov 02 14:00:23.439117 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.437845    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" event={"ID":"f419c032-58c1-4b81-809d-25af9d31453e","Type":"ContainerDied","Data":"2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5"}
Nov 02 14:00:23.439117 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.437895    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr" event={"ID":"f419c032-58c1-4b81-809d-25af9d31453e","Type":"ContainerDied","Data":"02e3ba17978721e60ebd136be0ef96f957beea5daf5a762602e4cb25d5ba49fd"}
Nov 02 14:00:23.443096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.440007    5453 generic.go:356] "Generic (PLEG): container finished" podID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerID="e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315" exitCode=0
Nov 02 14:00:23.443096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.440126    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" event={"ID":"231dcfc8-2f20-4320-af69-f0d190e5583a","Type":"ContainerDied","Data":"e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315"}
Nov 02 14:00:23.443096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.440167    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" event={"ID":"231dcfc8-2f20-4320-af69-f0d190e5583a","Type":"ContainerDied","Data":"a1414a9a8cbd739340a25473d0be7b62027e90d7e81b22c9961b0eee86d3591e"}
Nov 02 14:00:23.443096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.440232    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"
Nov 02 14:00:23.451923 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.451901    5453 scope.go:122] "RemoveContainer" containerID="59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009"
Nov 02 14:00:23.454369 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:23.454328    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009\": container with ID starting with 59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009 not found: ID does not exist" containerID="59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009"
Nov 02 14:00:23.454533 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.454380    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009"} err="failed to get container status \"59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009\": rpc error: code = NotFound desc = could not find container \"59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009\": container with ID starting with 59f10dc02c0400c11ebc52d59a1c013cd6b203d347fc2081abffe321fad71009 not found: ID does not exist"
Nov 02 14:00:23.454533 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.454410    5453 scope.go:122] "RemoveContainer" containerID="2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5"
Nov 02 14:00:23.463733 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.463697    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"]
Nov 02 14:00:23.468659 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.468622    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-2-w0-7a9443-kserve-5948b57f86-77z56"]
Nov 02 14:00:23.471282 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.471162    5453 scope.go:122] "RemoveContainer" containerID="2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5"
Nov 02 14:00:23.471592 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:23.471566    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5\": container with ID starting with 2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5 not found: ID does not exist" containerID="2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5"
Nov 02 14:00:23.471670 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.471605    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5"} err="failed to get container status \"2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5\": rpc error: code = NotFound desc = could not find container \"2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5\": container with ID starting with 2b9ef3bb7d93492c84057a9ad0ca4b65e44a32a6ec720c4ad277c334d58e08f5 not found: ID does not exist"
Nov 02 14:00:23.471670 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.471644    5453 scope.go:122] "RemoveContainer" containerID="e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315"
Nov 02 14:00:23.481512 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.481160    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"]
Nov 02 14:00:23.486425 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.484649    5453 scope.go:122] "RemoveContainer" containerID="e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315"
Nov 02 14:00:23.486425 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:23.485148    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315\": container with ID starting with e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315 not found: ID does not exist" containerID="e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315"
Nov 02 14:00:23.486425 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.485185    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315"} err="failed to get container status \"e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315\": rpc error: code = NotFound desc = could not find container \"e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315\": container with ID starting with e8917c008bd314f398be177e6e6f8f16ab58d0511e118774919e845ee6f15315 not found: ID does not exist"
Nov 02 14:00:23.487318 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.487294    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x"]
Nov 02 14:00:23.503233 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.503166    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"]
Nov 02 14:00:23.506381 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.506342    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7a9443/distinct-w0-7a9443-kserve-859db8b8b9-9vgxr"]
Nov 02 14:00:23.533260 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.533157    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:23.824268 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:23.824221    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7a9443/premium-w0-7a9443-kserve-ff649d86b-cdw9x" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:00:24.310187 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:24.310151    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:25.048851 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:25.048815    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" path="/var/lib/kubelet/pods/231dcfc8-2f20-4320-af69-f0d190e5583a/volumes"
Nov 02 14:00:25.049419 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:25.049396    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" path="/var/lib/kubelet/pods/3daa95f1-a1f8-4c2e-aab8-b2aee344b247/volumes"
Nov 02 14:00:25.049863 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:25.049846    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f419c032-58c1-4b81-809d-25af9d31453e" path="/var/lib/kubelet/pods/f419c032-58c1-4b81-809d-25af9d31453e/volumes"
Nov 02 14:00:25.105675 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:25.105646    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:25.328304 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:25.328207    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:25.463174 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:25.463137    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:25.713158 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:25.713031    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:26.021873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:26.021794    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:26.564401 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:26.564371    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:27.542092 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:27.541738    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:28.019155 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:28.018686    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:29.463098 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:29.452286    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded"
Nov 02 14:00:30.061101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:30.057722    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:30.211096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:30.210904    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:31.046860 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:31.046827    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:31.255105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:31.255045    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:31.369738 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:31.369634    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"]
Nov 02 14:00:31.376706 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:31.376661    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7a9443-q7wpx"]
Nov 02 14:00:31.436288 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:31.436175    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:31.588937 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:31.588896    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:31.971963 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:31.971915    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:32.633971 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:32.633937    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:33.013062 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:33.012956    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"]
Nov 02 14:00:33.045807 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:33.045768    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4fc05808-0f5c-4d7d-9dc0-2a4242cac93d" path="/var/lib/kubelet/pods/4fc05808-0f5c-4d7d-9dc0-2a4242cac93d/volumes"
Nov 02 14:00:33.046681 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:33.046660    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"]
Nov 02 14:00:33.200854 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:33.200821    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:33.926107 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:33.926010    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:34.744104 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:34.744044    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:34.942514 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:34.942479    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:34.992149 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:34.989178    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:35.010457 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.010425    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c8c17a4-0eab-420d-9d21-90bf56768a59-kube-api-access-n5vcv\" (UniqueName: \"kubernetes.io/projected/3c8c17a4-0eab-420d-9d21-90bf56768a59-kube-api-access-n5vcv\") pod \"3c8c17a4-0eab-420d-9d21-90bf56768a59\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") "
Nov 02 14:00:35.010666 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.010555    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c8c17a4-0eab-420d-9d21-90bf56768a59-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8c17a4-0eab-420d-9d21-90bf56768a59-maas-api-service-ca\") pod \"3c8c17a4-0eab-420d-9d21-90bf56768a59\" (UID: \"3c8c17a4-0eab-420d-9d21-90bf56768a59\") "
Nov 02 14:00:35.011611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.011313    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c8c17a4-0eab-420d-9d21-90bf56768a59-maas-api-service-ca" pod "3c8c17a4-0eab-420d-9d21-90bf56768a59" (UID: "3c8c17a4-0eab-420d-9d21-90bf56768a59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:35.016549 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.016514    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c8c17a4-0eab-420d-9d21-90bf56768a59-kube-api-access-n5vcv" pod "3c8c17a4-0eab-420d-9d21-90bf56768a59" (UID: "3c8c17a4-0eab-420d-9d21-90bf56768a59"). InnerVolumeSpecName "kube-api-access-n5vcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:35.112718 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.112658    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5vcv\" (UniqueName: \"kubernetes.io/projected/3c8c17a4-0eab-420d-9d21-90bf56768a59-kube-api-access-n5vcv\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:35.112718 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.112708    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8c17a4-0eab-420d-9d21-90bf56768a59-maas-api-service-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:35.183453 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.183413    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:35.310483 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.310442    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"]
Nov 02 14:00:35.310740 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.310669    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy" containerID="cri-o://2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5" gracePeriod=30
Nov 02 14:00:35.336451 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.336413    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"]
Nov 02 14:00:35.336807 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.336673    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" containerID="cri-o://5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb" gracePeriod=30
Nov 02 14:00:35.343220 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.343188    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"]
Nov 02 14:00:35.343538 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.343513    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy" containerID="cri-o://e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8" gracePeriod=30
Nov 02 14:00:35.442096 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.434940    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:35.756472 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.756372    5453 generic.go:356] "Generic (PLEG): container finished" podID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerID="9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356" exitCode=137
Nov 02 14:00:35.756472 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.756453    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"
Nov 02 14:00:35.756702 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.756464    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj" event={"ID":"3c8c17a4-0eab-420d-9d21-90bf56768a59","Type":"ContainerDied","Data":"9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356"}
Nov 02 14:00:35.756702 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.756519    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj" event={"ID":"3c8c17a4-0eab-420d-9d21-90bf56768a59","Type":"ContainerDied","Data":"a8967bbc572b9f7350e09ad44df5447c978559a9c2c91810bce0ed0d551a5e82"}
Nov 02 14:00:35.756702 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.756548    5453 scope.go:122] "RemoveContainer" containerID="9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356"
Nov 02 14:00:35.768537 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.768512    5453 scope.go:122] "RemoveContainer" containerID="01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5"
Nov 02 14:00:35.779580 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.779560    5453 scope.go:122] "RemoveContainer" containerID="9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356"
Nov 02 14:00:35.779942 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:35.779920    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356\": container with ID starting with 9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356 not found: ID does not exist" containerID="9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356"
Nov 02 14:00:35.780035 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.779949    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356"} err="failed to get container status \"9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356\": rpc error: code = NotFound desc = could not find container \"9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356\": container with ID starting with 9ea70502fa165e867f7eac92324354010c97bccbe92880bfc62816f34c951356 not found: ID does not exist"
Nov 02 14:00:35.780035 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.779968    5453 scope.go:122] "RemoveContainer" containerID="01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5"
Nov 02 14:00:35.780354 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:35.780325    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5\": container with ID starting with 01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5 not found: ID does not exist" containerID="01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5"
Nov 02 14:00:35.780407 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.780363    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5"} err="failed to get container status \"01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5\": rpc error: code = NotFound desc = could not find container \"01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5\": container with ID starting with 01850d9866017d8e138ae339ed4748dc18af6a0d61cc9bf642a462a690d9bab5 not found: ID does not exist"
Nov 02 14:00:35.797614 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.797574    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"]
Nov 02 14:00:35.802863 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.802723    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-4fc49b-29893800-s6kqj"]
Nov 02 14:00:35.870282 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:35.870246    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:36.090049 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:36.090012    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:00:36.777291 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:36.777254    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:37.046418 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:37.046385    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" path="/var/lib/kubelet/pods/3c8c17a4-0eab-420d-9d21-90bf56768a59/volumes"
Nov 02 14:00:37.927334 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:37.927295    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:38.718685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:38.718642    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:39.002151 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:39.000817    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:39.263224 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:39.263138    5453 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:39.263395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:39.263217    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:39.465176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:39.465140    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:39.627700 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:39.627632    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:39.922655 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:39.922560    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:40.077188 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.077146    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:40.627293 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.627263    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 14:00:40.654701 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.654667    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:40.678811 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.678767    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-certs\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679024 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.678847    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-envoy\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679024 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.678939    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f6027d12-ebaa-4c79-b5b2-57766db2d805-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6027d12-ebaa-4c79-b5b2-57766db2d805-istiod-ca-cert\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679024 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.678990    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-token\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-token\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.679035    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-podinfo\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.679152    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-credential-socket\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.679189    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-kube-api-access-wv6kr\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-kube-api-access-wv6kr\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.679261    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-socket\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.679471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.679356    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-data\") pod \"f6027d12-ebaa-4c79-b5b2-57766db2d805\" (UID: \"f6027d12-ebaa-4c79-b5b2-57766db2d805\") "
Nov 02 14:00:40.680533 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.680420    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-data" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.680715 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.680626    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-certs" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.693105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.684305    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-envoy" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.693105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.684644    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6027d12-ebaa-4c79-b5b2-57766db2d805-istiod-ca-cert" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:40.693105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.685732    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-credential-socket" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.693105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.685789    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-socket" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.693105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.688458    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-kube-api-access-wv6kr" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "kube-api-access-wv6kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:40.707442 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.703850    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-token" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:40.707442 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.705632    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-podinfo" pod "f6027d12-ebaa-4c79-b5b2-57766db2d805" (UID: "f6027d12-ebaa-4c79-b5b2-57766db2d805"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:40.735121 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.735089    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 14:00:40.743328 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.743295    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 14:00:40.781344 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.780645    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-token\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-token\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.781758 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.781649    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-podinfo\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.781758 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.781731    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-credential-socket\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782021 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.781992    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-credential-socket" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.782210 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782130    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-socket\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.782210 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782185    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-kube-api-access-9qc87\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-kube-api-access-9qc87\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.782340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782229    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-envoy\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782265    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-kube-api-access-vffk5\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-kube-api-access-vffk5\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782326    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-podinfo\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782494 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782368    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-certs\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782494 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782412    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-credential-socket\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.782494 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782439    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-data\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.782494 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782470    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istiod-ca-cert\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782698 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782495    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-envoy\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.782698 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782546    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istiod-ca-cert\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.782698 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782596    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-socket\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782698 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782636    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-token\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-token\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782698 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782659    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-data\") pod \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\" (UID: \"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9\") "
Nov 02 14:00:40.782946 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782701    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-certs\") pod \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\" (UID: \"5e21fcdd-669d-46d7-8233-35e037dfb1fb\") "
Nov 02 14:00:40.782946 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.782701    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-socket" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.783049 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783006    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istiod-ca-cert" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783462    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-certs" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783382    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783510    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783527    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv6kr\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-kube-api-access-wv6kr\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783544    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783559    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783574    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783589    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783605    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783620    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783634    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6027d12-ebaa-4c79-b5b2-57766db2d805-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783649    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.785163 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.783664    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6027d12-ebaa-4c79-b5b2-57766db2d805-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.787304 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.786887    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-credential-socket" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.787304 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.786911    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-certs" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.787304 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.787254    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-data" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.787304 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.787269    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-socket" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.787701 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.787308    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istiod-ca-cert" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:40.798740 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.797909    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-data" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.801011 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.800274    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-token" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:40.801468 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.801437    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-kube-api-access-vffk5" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "kube-api-access-vffk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:40.823352 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.823308    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-kube-api-access-9qc87" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "kube-api-access-9qc87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:40.829880 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.829712    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:40.831611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.831487    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-podinfo" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:40.831611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.831487    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-envoy" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.831611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.831584    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-podinfo" pod "5e21fcdd-669d-46d7-8233-35e037dfb1fb" (UID: "5e21fcdd-669d-46d7-8233-35e037dfb1fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:40.831858 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.831649    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-envoy" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:40.833625 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.833589    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-token" pod "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" (UID: "ea077ddb-105f-4fc6-9c8f-c1d890ba42c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:40.860780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.853164    5453 generic.go:356] "Generic (PLEG): container finished" podID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerID="5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb" exitCode=0
Nov 02 14:00:40.860780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.853466    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" event={"ID":"5e21fcdd-669d-46d7-8233-35e037dfb1fb","Type":"ContainerDied","Data":"5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb"}
Nov 02 14:00:40.860780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.853536    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7" event={"ID":"5e21fcdd-669d-46d7-8233-35e037dfb1fb","Type":"ContainerDied","Data":"507ae816f6ea955f07c84efb1d2bd91066cf29063819405d84344cd8a26dee2e"}
Nov 02 14:00:40.860780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.853568    5453 scope.go:122] "RemoveContainer" containerID="5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb"
Nov 02 14:00:40.860780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.853718    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"
Nov 02 14:00:40.870613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.869451    5453 generic.go:356] "Generic (PLEG): container finished" podID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerID="e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8" exitCode=0
Nov 02 14:00:40.870613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.869600    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"
Nov 02 14:00:40.870613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.870416    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" event={"ID":"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9","Type":"ContainerDied","Data":"e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8"}
Nov 02 14:00:40.870613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.870479    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm" event={"ID":"ea077ddb-105f-4fc6-9c8f-c1d890ba42c9","Type":"ContainerDied","Data":"d6e81ae5abf258603a2197db8a4db2795437c8dabb8aa8e1969f6c6c7dcc806d"}
Nov 02 14:00:40.873840 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.873756    5453 generic.go:356] "Generic (PLEG): container finished" podID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerID="2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5" exitCode=0
Nov 02 14:00:40.873840 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.873819    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"
Nov 02 14:00:40.874053 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.873843    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" event={"ID":"f6027d12-ebaa-4c79-b5b2-57766db2d805","Type":"ContainerDied","Data":"2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5"}
Nov 02 14:00:40.874053 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.873904    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd" event={"ID":"f6027d12-ebaa-4c79-b5b2-57766db2d805","Type":"ContainerDied","Data":"8fd63b20095b18a0a1bbb0ae71ec2181c021eaef7781599e268e2bbdde710e11"}
Nov 02 14:00:40.886765 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886729    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886770    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886786    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886800    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886813    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886827    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886859    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qc87\" (UniqueName: \"kubernetes.io/projected/5e21fcdd-669d-46d7-8233-35e037dfb1fb-kube-api-access-9qc87\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886876    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886892    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vffk5\" (UniqueName: \"kubernetes.io/projected/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-kube-api-access-vffk5\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886908    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886919    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886931    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.886939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886945    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.887620 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886958    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.887620 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.886971    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e21fcdd-669d-46d7-8233-35e037dfb1fb-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:40.898187 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.898135    5453 scope.go:122] "RemoveContainer" containerID="5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb"
Nov 02 14:00:40.899169 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:40.898868    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb\": container with ID starting with 5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb not found: ID does not exist" containerID="5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb"
Nov 02 14:00:40.899169 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.899034    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb"} err="failed to get container status \"5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb\": rpc error: code = NotFound desc = could not find container \"5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb\": container with ID starting with 5422a63dfd6e8c67ede9771d98dcd8fc58844f5b5c7f531f474eb2771dd1d3cb not found: ID does not exist"
Nov 02 14:00:40.899169 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.899088    5453 scope.go:122] "RemoveContainer" containerID="e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8"
Nov 02 14:00:40.921105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.921019    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"]
Nov 02 14:00:40.949196 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.949158    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-fhkf7"]
Nov 02 14:00:40.990539 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.990501    5453 scope.go:122] "RemoveContainer" containerID="e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8"
Nov 02 14:00:40.998984 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:40.998948    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8\": container with ID starting with e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8 not found: ID does not exist" containerID="e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8"
Nov 02 14:00:40.999718 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.999685    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8"} err="failed to get container status \"e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8\": rpc error: code = NotFound desc = could not find container \"e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8\": container with ID starting with e97b333b8252fc093ff6aa4ce454a2750051eae916813ba4b0e0473a60610ba8 not found: ID does not exist"
Nov 02 14:00:40.999869 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:40.999855    5453 scope.go:122] "RemoveContainer" containerID="2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5"
Nov 02 14:00:41.003646 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.003625    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"]
Nov 02 14:00:41.004214 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.004188    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy" containerID="cri-o://0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66" gracePeriod=30
Nov 02 14:00:41.027186 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.023248    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"]
Nov 02 14:00:41.028551 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.028500    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-l55cd"]
Nov 02 14:00:41.034097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.033294    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"]
Nov 02 14:00:41.034097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.033545    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" containerID="cri-o://08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914" gracePeriod=30
Nov 02 14:00:41.034097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.033751    5453 scope.go:122] "RemoveContainer" containerID="2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5"
Nov 02 14:00:41.039045 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:41.035608    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5\": container with ID starting with 2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5 not found: ID does not exist" containerID="2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5"
Nov 02 14:00:41.039045 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.035641    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5"} err="failed to get container status \"2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5\": rpc error: code = NotFound desc = could not find container \"2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5\": container with ID starting with 2173dd4e1c979fd9203c6d625adf38b4b0391166dc96e00e3d0a9bcd549716a5 not found: ID does not exist"
Nov 02 14:00:41.039045 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.038702    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"]
Nov 02 14:00:41.039045 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.039024    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" containerID="cri-o://f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9" gracePeriod=30
Nov 02 14:00:41.059476 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.059423    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" path="/var/lib/kubelet/pods/5e21fcdd-669d-46d7-8233-35e037dfb1fb/volumes"
Nov 02 14:00:41.060502 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.060185    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" path="/var/lib/kubelet/pods/f6027d12-ebaa-4c79-b5b2-57766db2d805/volumes"
Nov 02 14:00:41.061470 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.061437    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:41.061604 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.061536    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"]
Nov 02 14:00:41.064376 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:41.064346    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-q76gm"]
Nov 02 14:00:42.186287 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:42.186254    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:43.052718 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:43.052682    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" path="/var/lib/kubelet/pods/ea077ddb-105f-4fc6-9c8f-c1d890ba42c9/volumes"
Nov 02 14:00:44.042936 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:44.042884    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:44.213085 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:44.213036    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:44.361230 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:44.361117    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:44.442679 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:44.442638    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:44.442902 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:44.442720    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:44.501652 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:44.501618    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:45.631127 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:45.631085    5453 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 02 14:00:45.631559 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:45.631148    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 02 14:00:46.367955 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.360314    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 14:00:46.437301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.437269    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 14:00:46.476659 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.476620    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-istio-token\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-istio-token\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.476886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.476682    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-socket\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.476886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.476744    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-data\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.476886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.476802    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-kube-api-access-dwjm5\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-kube-api-access-dwjm5\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.476886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.476863    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9f12575-5635-46a5-a432-679f24f5622a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f12575-5635-46a5-a432-679f24f5622a-istiod-ca-cert\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.477171 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.476924    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-credential-socket\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.477171 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.477018    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b9f12575-5635-46a5-a432-679f24f5622a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f12575-5635-46a5-a432-679f24f5622a-istio-podinfo\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.477171 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.477052    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-envoy\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.477335 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.477206    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-certs\") pod \"b9f12575-5635-46a5-a432-679f24f5622a\" (UID: \"b9f12575-5635-46a5-a432-679f24f5622a\") "
Nov 02 14:00:46.477861 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.477834    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-data" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.477966 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.477904    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-certs" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.479323 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.479293    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-socket" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.479576 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.479555    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-credential-socket" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.480186 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.479844    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f12575-5635-46a5-a432-679f24f5622a-istiod-ca-cert" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:46.484197 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.484153    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-istio-token" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:46.484357 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.484199    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-envoy" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.484357 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.484260    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-kube-api-access-dwjm5" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "kube-api-access-dwjm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:46.484742 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.484710    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9f12575-5635-46a5-a432-679f24f5622a-istio-podinfo" pod "b9f12575-5635-46a5-a432-679f24f5622a" (UID: "b9f12575-5635-46a5-a432-679f24f5622a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:46.485324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.485297    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 14:00:46.579029 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.578925    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-credential-socket\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579029 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.578969    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-certs\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.579029 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579024    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-istio-token\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-istio-token\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.579324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579050    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-certs\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579112    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37e3bd29-f4ca-4411-8353-d618299080b3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e3bd29-f4ca-4411-8353-d618299080b3-istiod-ca-cert\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.579324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579148    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-credential-socket\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.579324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579180    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/37e3bd29-f4ca-4411-8353-d618299080b3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e3bd29-f4ca-4411-8353-d618299080b3-istio-podinfo\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.579324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579224    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88fa4536-b2b1-405f-a330-153023466f94-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fa4536-b2b1-405f-a330-153023466f94-istiod-ca-cert\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579269    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-data\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.579324 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579303    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-data\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579323    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-credential-socket" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.579613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579347    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-envoy\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579386    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-socket\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579441    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-kube-api-access-cqmt9\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-kube-api-access-cqmt9\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579535    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-istio-token\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-istio-token\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579573    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/88fa4536-b2b1-405f-a330-153023466f94-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fa4536-b2b1-405f-a330-153023466f94-istio-podinfo\") pod \"88fa4536-b2b1-405f-a330-153023466f94\" (UID: \"88fa4536-b2b1-405f-a330-153023466f94\") "
Nov 02 14:00:46.579613 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579602    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-kube-api-access-dhnv9\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-kube-api-access-dhnv9\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.580154 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579651    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-envoy\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.580154 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579670    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-data" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.580154 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.579708    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-socket\") pod \"37e3bd29-f4ca-4411-8353-d618299080b3\" (UID: \"37e3bd29-f4ca-4411-8353-d618299080b3\") "
Nov 02 14:00:46.580154 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580001    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88fa4536-b2b1-405f-a330-153023466f94-istiod-ca-cert" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:46.580379 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580260    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-data" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.580440 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580378    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580440 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580403    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580440 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580420    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580440 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580429    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-credential-socket" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580435    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580472    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580489    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwjm5\" (UniqueName: \"kubernetes.io/projected/b9f12575-5635-46a5-a432-679f24f5622a-kube-api-access-dwjm5\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580507    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88fa4536-b2b1-405f-a330-153023466f94-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580521    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580533    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580547    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f12575-5635-46a5-a432-679f24f5622a-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580562    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580575    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f12575-5635-46a5-a432-679f24f5622a-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.580637 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580588    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f12575-5635-46a5-a432-679f24f5622a-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.581142 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580695    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-certs" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.581142 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580776    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-certs" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.581142 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.580892    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e3bd29-f4ca-4411-8353-d618299080b3-istiod-ca-cert" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:46.581647 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.581621    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-socket" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.582565 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.582533    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37e3bd29-f4ca-4411-8353-d618299080b3-istio-podinfo" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:46.582873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.582797    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-socket" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.583182 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.583130    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-istio-token" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:46.583495 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.583453    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88fa4536-b2b1-405f-a330-153023466f94-istio-podinfo" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:00:46.583933 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.583913    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-kube-api-access-cqmt9" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "kube-api-access-cqmt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:46.584026 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.583996    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-istio-token" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:46.584157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.584134    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-envoy" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.584564 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.584542    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-envoy" pod "88fa4536-b2b1-405f-a330-153023466f94" (UID: "88fa4536-b2b1-405f-a330-153023466f94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:46.585580 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.585550    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-kube-api-access-dhnv9" pod "37e3bd29-f4ca-4411-8353-d618299080b3" (UID: "37e3bd29-f4ca-4411-8353-d618299080b3"). InnerVolumeSpecName "kube-api-access-dhnv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:46.681619 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681566    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.681619 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681608    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.681619 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681622    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681634    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e3bd29-f4ca-4411-8353-d618299080b3-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681651    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681662    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e3bd29-f4ca-4411-8353-d618299080b3-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681675    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681687    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88fa4536-b2b1-405f-a330-153023466f94-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681700    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqmt9\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-kube-api-access-cqmt9\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681713    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88fa4536-b2b1-405f-a330-153023466f94-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681725    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88fa4536-b2b1-405f-a330-153023466f94-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681738    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhnv9\" (UniqueName: \"kubernetes.io/projected/37e3bd29-f4ca-4411-8353-d618299080b3-kube-api-access-dhnv9\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681750    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.682309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.681762    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e3bd29-f4ca-4411-8353-d618299080b3-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:46.921865 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.921765    5453 generic.go:356] "Generic (PLEG): container finished" podID="88fa4536-b2b1-405f-a330-153023466f94" containerID="0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66" exitCode=0
Nov 02 14:00:46.921865 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.921845    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"
Nov 02 14:00:46.921865 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.921850    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" event={"ID":"88fa4536-b2b1-405f-a330-153023466f94","Type":"ContainerDied","Data":"0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66"}
Nov 02 14:00:46.922200 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.921950    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh" event={"ID":"88fa4536-b2b1-405f-a330-153023466f94","Type":"ContainerDied","Data":"ff6b58b7d19ceb303a559767274cad100cab1785840a3a29c63313c49883e6db"}
Nov 02 14:00:46.922200 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.921987    5453 scope.go:122] "RemoveContainer" containerID="0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66"
Nov 02 14:00:46.923642 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.923614    5453 generic.go:356] "Generic (PLEG): container finished" podID="37e3bd29-f4ca-4411-8353-d618299080b3" containerID="f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9" exitCode=0
Nov 02 14:00:46.923774 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.923695    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"
Nov 02 14:00:46.923774 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.923722    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" event={"ID":"37e3bd29-f4ca-4411-8353-d618299080b3","Type":"ContainerDied","Data":"f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9"}
Nov 02 14:00:46.923885 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.923775    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h" event={"ID":"37e3bd29-f4ca-4411-8353-d618299080b3","Type":"ContainerDied","Data":"c685d1fa6c5a345d75e908ab1b0b51a9981995a97f1ada91822c8ad0413a4702"}
Nov 02 14:00:46.925722 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.925694    5453 generic.go:356] "Generic (PLEG): container finished" podID="b9f12575-5635-46a5-a432-679f24f5622a" containerID="08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914" exitCode=0
Nov 02 14:00:46.925868 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.925733    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" event={"ID":"b9f12575-5635-46a5-a432-679f24f5622a","Type":"ContainerDied","Data":"08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914"}
Nov 02 14:00:46.925868 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.925771    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"
Nov 02 14:00:46.925868 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.925775    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j" event={"ID":"b9f12575-5635-46a5-a432-679f24f5622a","Type":"ContainerDied","Data":"1c1d2b70363621e0dd27e5e582a2f8a63ecac19a2e80920dcd00478cf801a517"}
Nov 02 14:00:46.937191 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.937169    5453 scope.go:122] "RemoveContainer" containerID="0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66"
Nov 02 14:00:46.937642 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:46.937615    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66\": container with ID starting with 0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66 not found: ID does not exist" containerID="0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66"
Nov 02 14:00:46.937752 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.937650    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66"} err="failed to get container status \"0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66\": rpc error: code = NotFound desc = could not find container \"0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66\": container with ID starting with 0bb90a7cc4111e1a03fedda8974cb271c5260d23d619ac772c9938122bd11b66 not found: ID does not exist"
Nov 02 14:00:46.937752 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.937669    5453 scope.go:122] "RemoveContainer" containerID="f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9"
Nov 02 14:00:46.948496 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.948460    5453 scope.go:122] "RemoveContainer" containerID="f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9"
Nov 02 14:00:46.948846 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:46.948816    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9\": container with ID starting with f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9 not found: ID does not exist" containerID="f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9"
Nov 02 14:00:46.948959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.948852    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9"} err="failed to get container status \"f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9\": rpc error: code = NotFound desc = could not find container \"f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9\": container with ID starting with f058a997ce1b978463cfa598f8b641b32d9eea9c58369faee8732ac1b93ab7d9 not found: ID does not exist"
Nov 02 14:00:46.948959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.948870    5453 scope.go:122] "RemoveContainer" containerID="08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914"
Nov 02 14:00:46.956352 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.956322    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"]
Nov 02 14:00:46.961588 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.961566    5453 scope.go:122] "RemoveContainer" containerID="08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914"
Nov 02 14:00:46.961940 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:46.961918    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914\": container with ID starting with 08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914 not found: ID does not exist" containerID="08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914"
Nov 02 14:00:46.962014 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.961949    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914"} err="failed to get container status \"08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914\": rpc error: code = NotFound desc = could not find container \"08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914\": container with ID starting with 08f42ef707e38cde6a285a183b0ff4eebe7ceaab58778af1de928266ebea7914 not found: ID does not exist"
Nov 02 14:00:46.963359 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.963336    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-x7blh"]
Nov 02 14:00:46.975579 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.975543    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"]
Nov 02 14:00:46.980100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.980049    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-9n99h"]
Nov 02 14:00:46.991956 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.991923    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"]
Nov 02 14:00:46.995280 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:46.995240    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-k5k9j"]
Nov 02 14:00:47.046242 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:47.046192    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" path="/var/lib/kubelet/pods/37e3bd29-f4ca-4411-8353-d618299080b3/volumes"
Nov 02 14:00:47.046898 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:47.046877    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88fa4536-b2b1-405f-a330-153023466f94" path="/var/lib/kubelet/pods/88fa4536-b2b1-405f-a330-153023466f94/volumes"
Nov 02 14:00:47.047507 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:47.047486    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9f12575-5635-46a5-a432-679f24f5622a" path="/var/lib/kubelet/pods/b9f12575-5635-46a5-a432-679f24f5622a/volumes"
Nov 02 14:00:47.887409 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:47.887375    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:48.036312 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.036263    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" containerID="cri-o://7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6" gracePeriod=45
Nov 02 14:00:48.041434 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.041396    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": EOF"
Nov 02 14:00:48.068368 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.068325    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main" containerID="cri-o://c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458" gracePeriod=45
Nov 02 14:00:48.356481 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.356442    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 14:00:48.403036 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.403003    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 14:00:48.503427 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503329    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-home\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-home\") pod \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") "
Nov 02 14:00:48.503427 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503401    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a74a849-251d-4635-afac-0662f5c22b65-kube-api-access-xfz28\" (UniqueName: \"kubernetes.io/projected/8a74a849-251d-4635-afac-0662f5c22b65-kube-api-access-xfz28\") pod \"8a74a849-251d-4635-afac-0662f5c22b65\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503433    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-model-cache\") pod \"8a74a849-251d-4635-afac-0662f5c22b65\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503450    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-dshm\") pod \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503485    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-home\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-home\") pod \"8a74a849-251d-4635-afac-0662f5c22b65\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503513    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tmp-dir\") pod \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503550    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-dshm\") pod \"8a74a849-251d-4635-afac-0662f5c22b65\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503588    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a74a849-251d-4635-afac-0662f5c22b65-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74a849-251d-4635-afac-0662f5c22b65-tls-certs\") pod \"8a74a849-251d-4635-afac-0662f5c22b65\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503641    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-kube-api-access-7j82t\" (UniqueName: \"kubernetes.io/projected/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-kube-api-access-7j82t\") pod \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") "
Nov 02 14:00:48.503682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503676    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tls-certs\" (UniqueName: \"kubernetes.io/secret/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tls-certs\") pod \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") "
Nov 02 14:00:48.504100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503684    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-home" pod "16ea93ea-4058-40a9-84de-f32c9bd9dbb4" (UID: "16ea93ea-4058-40a9-84de-f32c9bd9dbb4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.504100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503713    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-tmp-dir\") pod \"8a74a849-251d-4635-afac-0662f5c22b65\" (UID: \"8a74a849-251d-4635-afac-0662f5c22b65\") "
Nov 02 14:00:48.504100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503798    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-model-cache\") pod \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\" (UID: \"16ea93ea-4058-40a9-84de-f32c9bd9dbb4\") "
Nov 02 14:00:48.504100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503843    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-model-cache" pod "8a74a849-251d-4635-afac-0662f5c22b65" (UID: "8a74a849-251d-4635-afac-0662f5c22b65"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.504100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503865    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tmp-dir" pod "16ea93ea-4058-40a9-84de-f32c9bd9dbb4" (UID: "16ea93ea-4058-40a9-84de-f32c9bd9dbb4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.504100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.503883    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-home" pod "8a74a849-251d-4635-afac-0662f5c22b65" (UID: "8a74a849-251d-4635-afac-0662f5c22b65"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.504584 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.504135    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.504584 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.504156    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.504584 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.504169    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.504584 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.504181    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.504584 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.504136    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-tmp-dir" pod "8a74a849-251d-4635-afac-0662f5c22b65" (UID: "8a74a849-251d-4635-afac-0662f5c22b65"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.504584 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.504552    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-model-cache" pod "16ea93ea-4058-40a9-84de-f32c9bd9dbb4" (UID: "16ea93ea-4058-40a9-84de-f32c9bd9dbb4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.506221 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.506193    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-dshm" pod "16ea93ea-4058-40a9-84de-f32c9bd9dbb4" (UID: "16ea93ea-4058-40a9-84de-f32c9bd9dbb4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.506571 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.506546    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-kube-api-access-7j82t" pod "16ea93ea-4058-40a9-84de-f32c9bd9dbb4" (UID: "16ea93ea-4058-40a9-84de-f32c9bd9dbb4"). InnerVolumeSpecName "kube-api-access-7j82t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:48.506763 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.506733    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tls-certs" pod "16ea93ea-4058-40a9-84de-f32c9bd9dbb4" (UID: "16ea93ea-4058-40a9-84de-f32c9bd9dbb4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:48.506763 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.506759    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-dshm" pod "8a74a849-251d-4635-afac-0662f5c22b65" (UID: "8a74a849-251d-4635-afac-0662f5c22b65"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:00:48.506911 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.506860    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a74a849-251d-4635-afac-0662f5c22b65-kube-api-access-xfz28" pod "8a74a849-251d-4635-afac-0662f5c22b65" (UID: "8a74a849-251d-4635-afac-0662f5c22b65"). InnerVolumeSpecName "kube-api-access-xfz28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:48.506949 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.506911    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a74a849-251d-4635-afac-0662f5c22b65-tls-certs" pod "8a74a849-251d-4635-afac-0662f5c22b65" (UID: "8a74a849-251d-4635-afac-0662f5c22b65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:48.605009 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.604961    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.605009 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.605007    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfz28\" (UniqueName: \"kubernetes.io/projected/8a74a849-251d-4635-afac-0662f5c22b65-kube-api-access-xfz28\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.605272 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.605022    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.605272 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.605037    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.605272 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.605050    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74a849-251d-4635-afac-0662f5c22b65-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.605272 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.605099    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j82t\" (UniqueName: \"kubernetes.io/projected/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-kube-api-access-7j82t\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.605272 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.605113    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16ea93ea-4058-40a9-84de-f32c9bd9dbb4-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.605272 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.605126    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a74a849-251d-4635-afac-0662f5c22b65-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:48.944901 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.944861    5453 generic.go:356] "Generic (PLEG): container finished" podID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerID="7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6" exitCode=0
Nov 02 14:00:48.945458 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.944904    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"
Nov 02 14:00:48.945458 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.944939    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" event={"ID":"16ea93ea-4058-40a9-84de-f32c9bd9dbb4","Type":"ContainerDied","Data":"7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6"}
Nov 02 14:00:48.945458 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.944987    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw" event={"ID":"16ea93ea-4058-40a9-84de-f32c9bd9dbb4","Type":"ContainerDied","Data":"67233b36e83a656bac06b5693f5fd77e1efbbbfae8cdecf29e4fd82fab5429f7"}
Nov 02 14:00:48.945458 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.945004    5453 scope.go:122] "RemoveContainer" containerID="7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6"
Nov 02 14:00:48.946733 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.946705    5453 generic.go:356] "Generic (PLEG): container finished" podID="8a74a849-251d-4635-afac-0662f5c22b65" containerID="c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458" exitCode=0
Nov 02 14:00:48.946838 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.946766    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"
Nov 02 14:00:48.946838 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.946826    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" event={"ID":"8a74a849-251d-4635-afac-0662f5c22b65","Type":"ContainerDied","Data":"c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458"}
Nov 02 14:00:48.946951 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.946868    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669" event={"ID":"8a74a849-251d-4635-afac-0662f5c22b65","Type":"ContainerDied","Data":"53f5a8b66dcde9c20108fda95776781ed2adf41b02e4be8558ef60fe317664eb"}
Nov 02 14:00:48.956213 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.956192    5453 scope.go:122] "RemoveContainer" containerID="7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6"
Nov 02 14:00:48.956647 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:48.956618    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6\": container with ID starting with 7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6 not found: ID does not exist" containerID="7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6"
Nov 02 14:00:48.956780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.956653    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6"} err="failed to get container status \"7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6\": rpc error: code = NotFound desc = could not find container \"7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6\": container with ID starting with 7c2485f69840e868bafe00d5f5aaebc25fd424e476c188c9a11b86f1c53078a6 not found: ID does not exist"
Nov 02 14:00:48.956780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.956677    5453 scope.go:122] "RemoveContainer" containerID="c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458"
Nov 02 14:00:48.966542 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.966505    5453 scope.go:122] "RemoveContainer" containerID="c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458"
Nov 02 14:00:48.966870 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:00:48.966852    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458\": container with ID starting with c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458 not found: ID does not exist" containerID="c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458"
Nov 02 14:00:48.966925 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.966889    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458"} err="failed to get container status \"c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458\": rpc error: code = NotFound desc = could not find container \"c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458\": container with ID starting with c79213fd19298c5c971aaeaaee7e1b1edaae608216c8308aab18d5c7b1b97458 not found: ID does not exist"
Nov 02 14:00:48.975645 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.975610    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"]
Nov 02 14:00:48.979395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.979363    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/premium-w2-ee7df2-kserve-c9ccf54f9-zvrzw"]
Nov 02 14:00:48.991623 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.991591    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"]
Nov 02 14:00:48.996519 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:48.996489    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-ee7df2/simulator-w2-ee7df2-kserve-7c589c5dfd-7h669"]
Nov 02 14:00:49.026687 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:49.026653    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:49.044243 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:49.044211    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" path="/var/lib/kubelet/pods/16ea93ea-4058-40a9-84de-f32c9bd9dbb4/volumes"
Nov 02 14:00:49.044774 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:49.044747    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a74a849-251d-4635-afac-0662f5c22b65" path="/var/lib/kubelet/pods/8a74a849-251d-4635-afac-0662f5c22b65/volumes"
Nov 02 14:00:52.770301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:52.770263    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:54.060037 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:54.059983    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:55.828678 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:55.828634    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"]
Nov 02 14:00:55.829258 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:55.828986    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2" podUID="0c0a891d-d103-47a4-ab73-6860eefdcd0f" containerName="maas-api" containerID="cri-o://9263103dda52a9f25f46e336e7cc7c79c7908f163185042330b273f113a71324" gracePeriod=30
Nov 02 14:00:55.901060 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:55.901013    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:56.030734 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.030700    5453 generic.go:356] "Generic (PLEG): container finished" podID="0c0a891d-d103-47a4-ab73-6860eefdcd0f" containerID="9263103dda52a9f25f46e336e7cc7c79c7908f163185042330b273f113a71324" exitCode=0
Nov 02 14:00:56.030934 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.030782    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2" event={"ID":"0c0a891d-d103-47a4-ab73-6860eefdcd0f","Type":"ContainerDied","Data":"9263103dda52a9f25f46e336e7cc7c79c7908f163185042330b273f113a71324"}
Nov 02 14:00:56.082449 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.082351    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:56.111370 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.111341    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 14:00:56.210517 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.210455    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:56.215114 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.215039    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-metrics-certs\") pod \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") "
Nov 02 14:00:56.215329 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.215246    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c0a891d-d103-47a4-ab73-6860eefdcd0f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0a891d-d103-47a4-ab73-6860eefdcd0f-openshift-service-ca\") pod \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") "
Nov 02 14:00:56.215329 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.215284    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c0a891d-d103-47a4-ab73-6860eefdcd0f-kube-api-access-9bg7x\" (UniqueName: \"kubernetes.io/projected/0c0a891d-d103-47a4-ab73-6860eefdcd0f-kube-api-access-9bg7x\") pod \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") "
Nov 02 14:00:56.215467 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.215370    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-maas-api-tls\") pod \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\" (UID: \"0c0a891d-d103-47a4-ab73-6860eefdcd0f\") "
Nov 02 14:00:56.215706 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.215674    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c0a891d-d103-47a4-ab73-6860eefdcd0f-openshift-service-ca" pod "0c0a891d-d103-47a4-ab73-6860eefdcd0f" (UID: "0c0a891d-d103-47a4-ab73-6860eefdcd0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:00:56.217913 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.217876    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-metrics-certs" pod "0c0a891d-d103-47a4-ab73-6860eefdcd0f" (UID: "0c0a891d-d103-47a4-ab73-6860eefdcd0f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:56.219107 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.218559    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c0a891d-d103-47a4-ab73-6860eefdcd0f-kube-api-access-9bg7x" pod "0c0a891d-d103-47a4-ab73-6860eefdcd0f" (UID: "0c0a891d-d103-47a4-ab73-6860eefdcd0f"). InnerVolumeSpecName "kube-api-access-9bg7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:00:56.219107 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.218754    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-maas-api-tls" pod "0c0a891d-d103-47a4-ab73-6860eefdcd0f" (UID: "0c0a891d-d103-47a4-ab73-6860eefdcd0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:00:56.316910 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.316863    5453 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0a891d-d103-47a4-ab73-6860eefdcd0f-openshift-service-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:56.316910 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.316906    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bg7x\" (UniqueName: \"kubernetes.io/projected/0c0a891d-d103-47a4-ab73-6860eefdcd0f-kube-api-access-9bg7x\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:56.316910 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.316920    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-maas-api-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:56.317287 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.316933    5453 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0a891d-d103-47a4-ab73-6860eefdcd0f-metrics-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:00:56.645370 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:56.645333    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:00:57.038835 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:57.038804    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"
Nov 02 14:00:57.051685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:57.050928    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2" event={"ID":"0c0a891d-d103-47a4-ab73-6860eefdcd0f","Type":"ContainerDied","Data":"7be06026fd2727158549e93d539bcf577ea3ccfefa029704acdbd42721f302ff"}
Nov 02 14:00:57.051685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:57.051031    5453 scope.go:122] "RemoveContainer" containerID="9263103dda52a9f25f46e336e7cc7c79c7908f163185042330b273f113a71324"
Nov 02 14:00:57.073765 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:57.073724    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"]
Nov 02 14:00:57.078110 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:57.078079    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-ee7df2-7b6ff8866b-pmkh2"]
Nov 02 14:00:59.044948 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:00:59.044906    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c0a891d-d103-47a4-ab73-6860eefdcd0f" path="/var/lib/kubelet/pods/0c0a891d-d103-47a4-ab73-6860eefdcd0f/volumes"
Nov 02 14:01:02.698227 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:02.698110    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:02.844115 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:02.844045    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:03.025857 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:03.025718    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"]
Nov 02 14:01:03.026281 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:03.026226    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy" containerID="cri-o://bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec" gracePeriod=30
Nov 02 14:01:03.056029 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:03.055997    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"]
Nov 02 14:01:03.056354 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:03.056331    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"]
Nov 02 14:01:03.056703 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:03.056634    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy" containerID="cri-o://b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69" gracePeriod=30
Nov 02 14:01:03.056821 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:03.056753    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy" containerID="cri-o://52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb" gracePeriod=30
Nov 02 14:01:03.116887 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:03.116853    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:05.671500 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:05.671465    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b76f98b8f-7qg57"]
Nov 02 14:01:05.672220 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:05.671704    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-7b76f98b8f-7qg57" podUID="40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" containerName="manager" containerID="cri-o://da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584" gracePeriod=30
Nov 02 14:01:05.934061 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:05.933987    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 14:01:06.017168 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.017128    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-metrics-certs\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-metrics-certs\") pod \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") "
Nov 02 14:01:06.017380 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.017240    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-kube-api-access-lp2km\" (UniqueName: \"kubernetes.io/projected/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-kube-api-access-lp2km\") pod \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") "
Nov 02 14:01:06.017380 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.017273    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-webhook-cert\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-webhook-cert\") pod \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\" (UID: \"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459\") "
Nov 02 14:01:06.019529 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.019482    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-metrics-certs" pod "40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" (UID: "40382da8-1f0b-4e9d-bee8-ae2d0e8b7459"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:01:06.020028 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.019996    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-webhook-cert" pod "40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" (UID: "40382da8-1f0b-4e9d-bee8-ae2d0e8b7459"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:01:06.020028 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.020012    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-kube-api-access-lp2km" pod "40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" (UID: "40382da8-1f0b-4e9d-bee8-ae2d0e8b7459"). InnerVolumeSpecName "kube-api-access-lp2km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:01:06.085969 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:01:06.085930    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:01:06.106217 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.106184    5453 generic.go:356] "Generic (PLEG): container finished" podID="40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" containerID="da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584" exitCode=0
Nov 02 14:01:06.106418 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.106230    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b76f98b8f-7qg57"
Nov 02 14:01:06.106418 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.106261    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b76f98b8f-7qg57" event={"ID":"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459","Type":"ContainerDied","Data":"da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584"}
Nov 02 14:01:06.106418 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.106320    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b76f98b8f-7qg57" event={"ID":"40382da8-1f0b-4e9d-bee8-ae2d0e8b7459","Type":"ContainerDied","Data":"7e2b75069b9a74d38b7b75ac75dc29349b1d28bb32ffc0b28701f43d9353c818"}
Nov 02 14:01:06.106418 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.106343    5453 scope.go:122] "RemoveContainer" containerID="da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584"
Nov 02 14:01:06.116676 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.116653    5453 scope.go:122] "RemoveContainer" containerID="da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584"
Nov 02 14:01:06.117021 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:01:06.117002    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584\": container with ID starting with da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584 not found: ID does not exist" containerID="da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584"
Nov 02 14:01:06.117060 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.117031    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584"} err="failed to get container status \"da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584\": rpc error: code = NotFound desc = could not find container \"da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584\": container with ID starting with da1d94dadf8f39db975f3df137274d1aedbd64c65d53a9645e2a0af3843bf584 not found: ID does not exist"
Nov 02 14:01:06.118602 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.118577    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp2km\" (UniqueName: \"kubernetes.io/projected/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-kube-api-access-lp2km\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:06.118602 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.118604    5453 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-webhook-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:06.118753 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.118613    5453 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459-metrics-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:06.129372 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.129339    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b76f98b8f-7qg57"]
Nov 02 14:01:06.133541 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:06.133511    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b76f98b8f-7qg57"]
Nov 02 14:01:07.046550 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:07.046501    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" path="/var/lib/kubelet/pods/40382da8-1f0b-4e9d-bee8-ae2d0e8b7459/volumes"
Nov 02 14:01:08.725982 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.724631    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.812418    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813130    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-credential-socket\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813175    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/84dfe184-d563-489e-a953-1be14a11d4b0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84dfe184-d563-489e-a953-1be14a11d4b0-istio-podinfo\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813226    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-socket\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813276    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-data\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813323    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-kube-api-access-xt84b\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-kube-api-access-xt84b\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813365    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-envoy\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813404    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84dfe184-d563-489e-a953-1be14a11d4b0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84dfe184-d563-489e-a953-1be14a11d4b0-istiod-ca-cert\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813462    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-certs\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.813539    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-istio-token\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-istio-token\") pod \"84dfe184-d563-489e-a953-1be14a11d4b0\" (UID: \"84dfe184-d563-489e-a953-1be14a11d4b0\") "
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.818651    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-istio-token" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:01:08.820297 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.818938    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-credential-socket" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:08.823803 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.823554    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-certs" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:08.823803 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.823750    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-data" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:08.824136 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.824101    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-socket" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:08.824406 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.824373    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84dfe184-d563-489e-a953-1be14a11d4b0-istiod-ca-cert" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:01:08.827151 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.827062    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84dfe184-d563-489e-a953-1be14a11d4b0-istio-podinfo" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:01:08.827738 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.827701    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-envoy" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:08.848104 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.842299    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-kube-api-access-xt84b" pod "84dfe184-d563-489e-a953-1be14a11d4b0" (UID: "84dfe184-d563-489e-a953-1be14a11d4b0"). InnerVolumeSpecName "kube-api-access-xt84b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914441    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-istio-token\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-istio-token\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914509    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aac832da-523d-4f2e-b231-a13faa06d78d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aac832da-523d-4f2e-b231-a13faa06d78d-istiod-ca-cert\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914606    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-envoy\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914644    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/aac832da-523d-4f2e-b231-a13faa06d78d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aac832da-523d-4f2e-b231-a13faa06d78d-istio-podinfo\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914697    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-data\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914745    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-socket\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914794    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-kube-api-access-nj2wd\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-kube-api-access-nj2wd\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914826    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-credential-socket\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.917097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.914882    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-certs\") pod \"aac832da-523d-4f2e-b231-a13faa06d78d\" (UID: \"aac832da-523d-4f2e-b231-a13faa06d78d\") "
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920281    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920338    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84dfe184-d563-489e-a953-1be14a11d4b0-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920357    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920375    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920391    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt84b\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-kube-api-access-xt84b\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920413    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920430    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84dfe184-d563-489e-a953-1be14a11d4b0-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920444    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84dfe184-d563-489e-a953-1be14a11d4b0-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.927257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.920659    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84dfe184-d563-489e-a953-1be14a11d4b0-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:08.928657 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.928240    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-data" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:08.932876 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.932617    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-istio-token" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:01:08.933535 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.933211    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aac832da-523d-4f2e-b231-a13faa06d78d-istiod-ca-cert" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:01:09.011153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.935368    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-certs" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.011153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.935577    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-socket" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.011153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:08.935634    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-credential-socket" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.011685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.011624    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-envoy" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.023176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.022712    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.023176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.022751    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.023176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.022776    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.023176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.023044    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.023176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.023123    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac832da-523d-4f2e-b231-a13faa06d78d-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.023176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.023141    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.023176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.023165    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aac832da-523d-4f2e-b231-a13faa06d78d-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.023941 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.023622    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 14:01:09.025422 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.025278    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aac832da-523d-4f2e-b231-a13faa06d78d-istio-podinfo" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:01:09.025978 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.025930    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-kube-api-access-nj2wd" pod "aac832da-523d-4f2e-b231-a13faa06d78d" (UID: "aac832da-523d-4f2e-b231-a13faa06d78d"). InnerVolumeSpecName "kube-api-access-nj2wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124482    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-kube-api-access-rm79x\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-kube-api-access-rm79x\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124543    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-podinfo\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124583    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-envoy\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124626    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-token\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-token\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124695    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-data\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124786    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-certs\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124816    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-socket\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124860    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-credential-socket\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.124892    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f42eabaf-2e91-43c8-becc-96fece2cc472-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42eabaf-2e91-43c8-becc-96fece2cc472-istiod-ca-cert\") pod \"f42eabaf-2e91-43c8-becc-96fece2cc472\" (UID: \"f42eabaf-2e91-43c8-becc-96fece2cc472\") "
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.125291    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aac832da-523d-4f2e-b231-a13faa06d78d-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.125315    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj2wd\" (UniqueName: \"kubernetes.io/projected/aac832da-523d-4f2e-b231-a13faa06d78d-kube-api-access-nj2wd\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.125721    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f42eabaf-2e91-43c8-becc-96fece2cc472-istiod-ca-cert" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.125984    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-data" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.126188    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-certs" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.126361    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-socket" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.126528    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-credential-socket" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.127966    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-token" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:01:09.129683 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.129229    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-podinfo" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 02 14:01:09.131271 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.130596    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-envoy" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:01:09.131271 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.130892    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-kube-api-access-rm79x" pod "f42eabaf-2e91-43c8-becc-96fece2cc472" (UID: "f42eabaf-2e91-43c8-becc-96fece2cc472"). InnerVolumeSpecName "kube-api-access-rm79x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:01:09.210281 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.209307    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"
Nov 02 14:01:09.218414 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.213137    5453 generic.go:356] "Generic (PLEG): container finished" podID="aac832da-523d-4f2e-b231-a13faa06d78d" containerID="b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69" exitCode=0
Nov 02 14:01:09.218414 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.213363    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" event={"ID":"aac832da-523d-4f2e-b231-a13faa06d78d","Type":"ContainerDied","Data":"b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69"}
Nov 02 14:01:09.218414 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.213426    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv" event={"ID":"aac832da-523d-4f2e-b231-a13faa06d78d","Type":"ContainerDied","Data":"5594819be820962c044d749df670f414b7701998fbeb6e5a408321f438d78d7f"}
Nov 02 14:01:09.218414 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.213460    5453 scope.go:122] "RemoveContainer" containerID="b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69"
Nov 02 14:01:09.223334 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.223283    5453 generic.go:356] "Generic (PLEG): container finished" podID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerID="bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec" exitCode=0
Nov 02 14:01:09.223532 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.223356    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"
Nov 02 14:01:09.223881 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.223826    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" event={"ID":"f42eabaf-2e91-43c8-becc-96fece2cc472","Type":"ContainerDied","Data":"bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec"}
Nov 02 14:01:09.224154 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.224105    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj" event={"ID":"f42eabaf-2e91-43c8-becc-96fece2cc472","Type":"ContainerDied","Data":"dbe0a204a137859b20b4b5a5c7c4326ec531e3e44169f05f1b1b77e358362c13"}
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.225967    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.225999    5453 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-data\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.226015    5453 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.226031    5453 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-workload-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.226045    5453 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-credential-socket\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.226059    5453 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42eabaf-2e91-43c8-becc-96fece2cc472-istiod-ca-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.226102    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm79x\" (UniqueName: \"kubernetes.io/projected/f42eabaf-2e91-43c8-becc-96fece2cc472-kube-api-access-rm79x\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.226119    5453 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-podinfo\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.226157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.226133    5453 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42eabaf-2e91-43c8-becc-96fece2cc472-istio-envoy\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:01:09.227417 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.227391    5453 generic.go:356] "Generic (PLEG): container finished" podID="84dfe184-d563-489e-a953-1be14a11d4b0" containerID="52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb" exitCode=0
Nov 02 14:01:09.227534 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.227450    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" event={"ID":"84dfe184-d563-489e-a953-1be14a11d4b0","Type":"ContainerDied","Data":"52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb"}
Nov 02 14:01:09.227534 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.227490    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr" event={"ID":"84dfe184-d563-489e-a953-1be14a11d4b0","Type":"ContainerDied","Data":"ed33699e82d1f599bf2d7d0f5dc20f53b76afe63cd616d3c52d3d59cebb8be0f"}
Nov 02 14:01:09.227661 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.227580    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"
Nov 02 14:01:09.234275 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.234257    5453 scope.go:122] "RemoveContainer" containerID="b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69"
Nov 02 14:01:09.234580 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:01:09.234553    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69\": container with ID starting with b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69 not found: ID does not exist" containerID="b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69"
Nov 02 14:01:09.234657 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.234593    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69"} err="failed to get container status \"b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69\": rpc error: code = NotFound desc = could not find container \"b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69\": container with ID starting with b25eceeef3af6fc02ecf7db879c350a2ee1589ab1a98597d55e6f1e6568b7e69 not found: ID does not exist"
Nov 02 14:01:09.234657 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.234618    5453 scope.go:122] "RemoveContainer" containerID="bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec"
Nov 02 14:01:09.318696 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.318647    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"]
Nov 02 14:01:09.320516 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.320454    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-2lzzv"]
Nov 02 14:01:09.321450 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.321422    5453 scope.go:122] "RemoveContainer" containerID="bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec"
Nov 02 14:01:09.321862 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:01:09.321837    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec\": container with ID starting with bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec not found: ID does not exist" containerID="bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec"
Nov 02 14:01:09.321939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.321872    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec"} err="failed to get container status \"bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec\": rpc error: code = NotFound desc = could not find container \"bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec\": container with ID starting with bc66cfbe5533b134bd6d53496bf9673dba86fae9dde8af333c5c8b199ac02eec not found: ID does not exist"
Nov 02 14:01:09.321939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.321898    5453 scope.go:122] "RemoveContainer" containerID="52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb"
Nov 02 14:01:09.322760 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.322738    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"]
Nov 02 14:01:09.324734 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.324704    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-wg7wr"]
Nov 02 14:01:09.326574 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.326550    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"]
Nov 02 14:01:09.328240 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.328214    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-7jxrj"]
Nov 02 14:01:09.333658 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.333642    5453 scope.go:122] "RemoveContainer" containerID="52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb"
Nov 02 14:01:09.334059 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:01:09.334040    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb\": container with ID starting with 52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb not found: ID does not exist" containerID="52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb"
Nov 02 14:01:09.334164 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.334143    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb"} err="failed to get container status \"52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb\": rpc error: code = NotFound desc = could not find container \"52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb\": container with ID starting with 52e5245e0cc2340ec0672f7f52f232b8d8fb65f15fdd4b53572846ce6b944fdb not found: ID does not exist"
Nov 02 14:01:09.916789 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:09.916754    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:10.072270 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:10.072237    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:10.214787 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:10.214698    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:10.378994 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:10.378907    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:11.044861 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:11.044819    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" path="/var/lib/kubelet/pods/84dfe184-d563-489e-a953-1be14a11d4b0/volumes"
Nov 02 14:01:11.045439 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:11.045419    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" path="/var/lib/kubelet/pods/aac832da-523d-4f2e-b231-a13faa06d78d/volumes"
Nov 02 14:01:11.045984 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:11.045967    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" path="/var/lib/kubelet/pods/f42eabaf-2e91-43c8-becc-96fece2cc472/volumes"
Nov 02 14:01:12.041452 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:12.041420    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:17.845089 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:17.845038    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:23.163001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:23.162967    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:36.082961 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:01:36.082921    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:01:37.844525 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:37.844493    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:37.978448 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:37.978379    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:38.289765 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:38.289738    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:39.872252 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:39.872206    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:01:52.837339 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:01:52.837254    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:02:06.082900 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:02:06.082857    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:02:22.525899 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:02:22.525354    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:02:36.083319 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:02:36.083267    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:02:46.983425 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:02:46.983354    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:02:47.155505 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:02:47.155443    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:02:52.862543 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:02:52.862509    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:02:53.162690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:02:53.162566    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:03:06.087391 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:03:06.087348    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:03:36.081880 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:03:36.081839    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:03:53.023388 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:03:53.023353    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:03:53.232587 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:03:53.232542    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:04:06.083865 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:04:06.083824    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:04:11.206303 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:04:11.206269    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:04:36.102162 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:04:36.102112    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:04:53.087612 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:04:53.087523    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:04:53.248135 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:04:53.248104    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:04:54.032160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:04:54.032116    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"]
Nov 02 14:04:54.039447 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:04:54.039409    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0035b537-w4s2q"]
Nov 02 14:04:55.043618 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:04:55.043577    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c326e938-8b04-447b-93df-34bd878f033b" path="/var/lib/kubelet/pods/c326e938-8b04-447b-93df-34bd878f033b/volumes"
Nov 02 14:05:06.142124 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:05:06.139551    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:05:10.025426 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:10.025384    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"]
Nov 02 14:05:10.028213 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:10.028186    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-18be6031-zcpks"]
Nov 02 14:05:11.044408 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:11.044357    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="293cffaa-141f-4002-98ec-e12c0e7a7fbd" path="/var/lib/kubelet/pods/293cffaa-141f-4002-98ec-e12c0e7a7fbd/volumes"
Nov 02 14:05:16.036694 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:16.036624    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"]
Nov 02 14:05:16.040101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:16.040056    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36626402-qhdjm"]
Nov 02 14:05:17.042267 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:17.042232    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ee81f3f-e736-47e6-88c7-cb0bbc7019eb" path="/var/lib/kubelet/pods/2ee81f3f-e736-47e6-88c7-cb0bbc7019eb/volumes"
Nov 02 14:05:21.054243 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:21.054194    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"]
Nov 02 14:05:21.055800 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:21.055774    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"]
Nov 02 14:05:21.066557 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:21.066517    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46575c20-fpcpm"]
Nov 02 14:05:21.070269 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:21.070235    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a99d0aa5-75njr"]
Nov 02 14:05:23.042452 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:23.042414    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1631553c-ce05-4029-892e-75dbc340e016" path="/var/lib/kubelet/pods/1631553c-ce05-4029-892e-75dbc340e016/volumes"
Nov 02 14:05:23.042870 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:23.042800    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c54e457a-219b-4a84-a32a-8e255dc83cc2" path="/var/lib/kubelet/pods/c54e457a-219b-4a84-a32a-8e255dc83cc2/volumes"
Nov 02 14:05:29.910359 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:29.910289    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:05:30.112911 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:30.112867    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:05:36.084312 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:05:36.084267    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:05:53.076164 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:53.076116    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:05:53.204922 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:53.204886    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:05:57.366100 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.366041    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"]
Nov 02 14:05:57.366627 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.366364    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s" podUID="3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" containerName="discovery" containerID="cri-o://8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87" gracePeriod=30
Nov 02 14:05:57.618806 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.618727    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:05:57.749357 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.749317    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-cacerts\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-cacerts\") pod \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") "
Nov 02 14:05:57.749585 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.749374    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-kubeconfig\") pod \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") "
Nov 02 14:05:57.749585 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.749424    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-kube-api-access-k6ksj\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-kube-api-access-k6ksj\") pod \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") "
Nov 02 14:05:57.749585 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.749468    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-local-certs\") pod \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") "
Nov 02 14:05:57.749585 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.749489    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-token\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-token\") pod \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") "
Nov 02 14:05:57.749585 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.749520    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-dns-cert\") pod \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") "
Nov 02 14:05:57.749585 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.749584    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-ca-configmap\") pod \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\" (UID: \"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb\") "
Nov 02 14:05:57.750204 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.750169    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-ca-configmap" pod "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" (UID: "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:05:57.752120 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.752040    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-dns-cert" pod "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" (UID: "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:05:57.752120 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.752048    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-local-certs" pod "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" (UID: "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:05:57.752404 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.752377    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-token" pod "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" (UID: "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:05:57.752524 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.752381    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-cacerts" pod "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" (UID: "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:05:57.752524 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.752477    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-kube-api-access-k6ksj" pod "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" (UID: "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb"). InnerVolumeSpecName "kube-api-access-k6ksj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:05:57.752648 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.752562    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-kubeconfig" pod "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" (UID: "3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:05:57.850706 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.850667    5453 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-ca-configmap\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:05:57.850706 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.850703    5453 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-cacerts\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:05:57.850706 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.850712    5453 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-kubeconfig\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:05:57.850964 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.850721    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6ksj\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-kube-api-access-k6ksj\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:05:57.850964 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.850731    5453 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-local-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:05:57.850964 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.850739    5453 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-token\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:05:57.850964 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:57.850747    5453 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb-istio-csr-dns-cert\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:05:58.041707 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.041665    5453 generic.go:356] "Generic (PLEG): container finished" podID="3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" containerID="8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87" exitCode=0
Nov 02 14:05:58.041901 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.041717    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"
Nov 02 14:05:58.041901 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.041749    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s" event={"ID":"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb","Type":"ContainerDied","Data":"8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87"}
Nov 02 14:05:58.041901 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.041806    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s" event={"ID":"3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb","Type":"ContainerDied","Data":"78c47b28459742067afe5f01c42dc2e5447d059cf8f8732d53f2aba0040119d5"}
Nov 02 14:05:58.041901 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.041828    5453 scope.go:122] "RemoveContainer" containerID="8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87"
Nov 02 14:05:58.052902 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.052881    5453 scope.go:122] "RemoveContainer" containerID="8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87"
Nov 02 14:05:58.053293 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:05:58.053272    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87\": container with ID starting with 8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87 not found: ID does not exist" containerID="8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87"
Nov 02 14:05:58.053367 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.053306    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87"} err="failed to get container status \"8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87\": rpc error: code = NotFound desc = could not find container \"8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87\": container with ID starting with 8f16c492cf34ea20745083c15cf8e16cd4cc238cf8036535cb277d86fdfa8e87 not found: ID does not exist"
Nov 02 14:05:58.067027 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.066988    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"]
Nov 02 14:05:58.072557 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:58.072520    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-6f99s"]
Nov 02 14:05:59.042673 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:05:59.042634    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" path="/var/lib/kubelet/pods/3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb/volumes"
Nov 02 14:06:06.219022 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:06:06.218965    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:06:35.125222 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:35.125189    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:06:36.082053 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:06:36.082015    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:06:42.898210 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:42.898176    5453 scope.go:122] "RemoveContainer" containerID="5c458cfd0888fefa2c5b4dcc17a5e07ee82551905177e8943cc69d94de07e5a6"
Nov 02 14:06:42.908060 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:42.908036    5453 scope.go:122] "RemoveContainer" containerID="a5c1518104cd9b2e37d197ccf3b684063d3b5291098e740a4dad2ae10c633ad8"
Nov 02 14:06:42.917186 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:42.917162    5453 scope.go:122] "RemoveContainer" containerID="db4608bd91d0b58cdba1bc70f272f16ac97c8bc0e49391a0f0bd239d99e5652f"
Nov 02 14:06:42.926153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:42.926128    5453 scope.go:122] "RemoveContainer" containerID="be06bf38935bdf972522b2765a1b698454e6266ee0223e1047d64b21673b4637"
Nov 02 14:06:42.935130 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:42.935107    5453 scope.go:122] "RemoveContainer" containerID="957b5e2fa17820e604debdbdfaee6755ff5161fc20d8cfb0f617e306ef882eaf"
Nov 02 14:06:42.943838 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:42.943818    5453 scope.go:122] "RemoveContainer" containerID="94a07f60927e9d761ebbb2f3c39823cadc9660a75c5ce59e6771f5bb641240ca"
Nov 02 14:06:55.599182 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:55.599147    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:06:55.732452 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:06:55.732420    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:06.085735 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:07:06.085699    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:07:11.355435 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:11.355394    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:11.800810 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:11.800768    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:11.940826 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:11.940793    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:15.614546 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:15.614510    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:15.759010 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:15.758957    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:17.197972 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:17.197936    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:17.446774 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:17.446738    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:18.184854 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:18.184814    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:18.989722 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:18.989677    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:19.983131 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:19.983056    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:20.993671 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:20.993634    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:21.782207 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:21.782172    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:22.740126 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:22.740061    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:23.515384 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:23.515334    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:24.443379 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:24.443320    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:25.829382 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:25.829328    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:26.196463 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:26.196377    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:27.005776 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:27.005718    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:27.883489 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:27.883439    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:28.768599 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:28.768560    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:29.609995 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:29.609957    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:30.274423 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:30.274387    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:30.709183 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:30.709141    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:31.260400 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:31.260363    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:31.421699 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:31.421661    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:32.609020 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:32.608985    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:33.131956 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.131920    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"]
Nov 02 14:07:33.132385 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132363    5453 cpu_manager.go:414] "containerMap: removing container" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy"
Nov 02 14:07:33.132385 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132384    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132400    5453 cpu_manager.go:414] "containerMap: removing container" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132409    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132423    5453 cpu_manager.go:414] "containerMap: removing container" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132429    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132436    5453 cpu_manager.go:414] "containerMap: removing container" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132442    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132455    5453 cpu_manager.go:414] "containerMap: removing container" podUID="0c0a891d-d103-47a4-ab73-6860eefdcd0f" containerName="maas-api"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132462    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c0a891d-d103-47a4-ab73-6860eefdcd0f" containerName="maas-api"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132470    5453 cpu_manager.go:414] "containerMap: removing container" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132475    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132482    5453 cpu_manager.go:414] "containerMap: removing container" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerName="cleanup"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132486    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerName="cleanup"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132491    5453 cpu_manager.go:414] "containerMap: removing container" podUID="3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" containerName="discovery"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132495    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" containerName="discovery"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132508    5453 cpu_manager.go:414] "containerMap: removing container" podUID="40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" containerName="manager"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132512    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" containerName="manager"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132527    5453 cpu_manager.go:414] "containerMap: removing container" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132534    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132542    5453 cpu_manager.go:414] "containerMap: removing container" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132547    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132554    5453 cpu_manager.go:414] "containerMap: removing container" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132561    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132572    5453 cpu_manager.go:414] "containerMap: removing container" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132579    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132588    5453 cpu_manager.go:414] "containerMap: removing container" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132592    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132598    5453 cpu_manager.go:414] "containerMap: removing container" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132604    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132616    5453 cpu_manager.go:414] "containerMap: removing container" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132623    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132632    5453 cpu_manager.go:414] "containerMap: removing container" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132638    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132645    5453 cpu_manager.go:414] "containerMap: removing container" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132649    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132658    5453 cpu_manager.go:414] "containerMap: removing container" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerName="cleanup"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132664    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerName="cleanup"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132670    5453 cpu_manager.go:414] "containerMap: removing container" podUID="1631553c-ce05-4029-892e-75dbc340e016" containerName="revoke-keys"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132675    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1631553c-ce05-4029-892e-75dbc340e016" containerName="revoke-keys"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132683    5453 cpu_manager.go:414] "containerMap: removing container" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132690    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132698    5453 cpu_manager.go:414] "containerMap: removing container" podUID="c54e457a-219b-4a84-a32a-8e255dc83cc2" containerName="revoke-keys"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132706    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c54e457a-219b-4a84-a32a-8e255dc83cc2" containerName="revoke-keys"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132715    5453 cpu_manager.go:414] "containerMap: removing container" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy"
Nov 02 14:07:33.132690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132722    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132735    5453 cpu_manager.go:414] "containerMap: removing container" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132742    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132754    5453 cpu_manager.go:414] "containerMap: removing container" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132760    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132769    5453 cpu_manager.go:414] "containerMap: removing container" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132775    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132786    5453 cpu_manager.go:414] "containerMap: removing container" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132792    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132801    5453 cpu_manager.go:414] "containerMap: removing container" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132807    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132818    5453 cpu_manager.go:414] "containerMap: removing container" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132824    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132833    5453 cpu_manager.go:414] "containerMap: removing container" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132839    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132942    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="f419c032-58c1-4b81-809d-25af9d31453e" containerName="main"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132953    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="664674d2-5544-48f2-a75e-6dd5e48ea244" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132963    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="5e21fcdd-669d-46d7-8233-35e037dfb1fb" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132973    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="37e3bd29-f4ca-4411-8353-d618299080b3" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132980    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerName="cleanup"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132986    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="1631553c-ce05-4029-892e-75dbc340e016" containerName="revoke-keys"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.132996    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="16ea93ea-4058-40a9-84de-f32c9bd9dbb4" containerName="main"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133004    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="c54e457a-219b-4a84-a32a-8e255dc83cc2" containerName="revoke-keys"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133012    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f12575-5635-46a5-a432-679f24f5622a" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133022    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6027d12-ebaa-4c79-b5b2-57766db2d805" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133032    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="0361eb54-8d3a-4522-8d65-176c37a4aa24" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133040    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="64b50361-73ce-4714-8eee-7852ab9d077f" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133049    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="105ffa58-e906-4ad5-b587-cf3245cc1c03" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133056    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="aac832da-523d-4f2e-b231-a13faa06d78d" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133101    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="84dfe184-d563-489e-a953-1be14a11d4b0" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133111    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="f42eabaf-2e91-43c8-becc-96fece2cc472" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133119    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133126    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="a105dea4-399c-49a9-aacc-72f443e80de2" containerName="main"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133135    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="119b10e2-6c1b-42de-a168-8348caafd4d6" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133143    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="3daa95f1-a1f8-4c2e-aab8-b2aee344b247" containerName="main"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133152    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c0a891d-d103-47a4-ab73-6860eefdcd0f" containerName="maas-api"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133159    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a74a849-251d-4635-afac-0662f5c22b65" containerName="main"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133178    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e7ec0fc-6a95-4380-9cdc-6aa71a6d88bb" containerName="discovery"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133188    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="40382da8-1f0b-4e9d-bee8-ae2d0e8b7459" containerName="manager"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133199    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="231dcfc8-2f20-4320-af69-f0d190e5583a" containerName="main"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133206    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea077ddb-105f-4fc6-9c8f-c1d890ba42c9" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133213    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="88fa4536-b2b1-405f-a330-153023466f94" containerName="istio-proxy"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133221    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f2e3ba0-8157-491c-985f-272f60c674a8" containerName="main"
Nov 02 14:07:33.135160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.133229    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2ffe821-d125-4899-926e-395d1fe2fa95" containerName="main"
Nov 02 14:07:33.137557 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.136626    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.144157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.144131    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-0c51da\"/\"kube-root-ca.crt\""
Nov 02 14:07:33.149894 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.149868    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-0c51da\"/\"simulator-single-main-0c51da-kserve-self-signed-certs\""
Nov 02 14:07:33.152442 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.152382    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"]
Nov 02 14:07:33.161274 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.161243    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-0c51da\"/\"default-dockercfg-2qcs8\""
Nov 02 14:07:33.227855 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.227814    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tls-certs\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.228058 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.227885    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7mrt\" (UniqueName: \"kubernetes.io/projected/09b26bf7-8c83-4188-b3b9-c03ef05491bc-kube-api-access-z7mrt\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.228058 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.227995    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tmp-dir\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.228214 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.228141    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-home\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.228214 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.228199    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-dshm\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.228307 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.228241    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-model-cache\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.246862 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.246826    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-0c51da\"/\"openshift-service-ca.crt\""
Nov 02 14:07:33.329034 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.328987    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-model-cache\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329034 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329043    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tls-certs\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329108    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7mrt\" (UniqueName: \"kubernetes.io/projected/09b26bf7-8c83-4188-b3b9-c03ef05491bc-kube-api-access-z7mrt\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329129    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tmp-dir\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329168    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-home\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329202    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-dshm\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329545 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329515    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-model-cache\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329606 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329591    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tmp-dir\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.329701 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.329683    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-home\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.333233 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.332938    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tls-certs\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.333233 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.333159    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-dshm\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.353506 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.353446    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:33.358001 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.357967    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7mrt\" (UniqueName: \"kubernetes.io/projected/09b26bf7-8c83-4188-b3b9-c03ef05491bc-kube-api-access-z7mrt\") pod \"simulator-single-main-0c51da-kserve-fd769f858-sgsbt\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") " pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.460723 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.460630    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:33.751924 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.751897    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"]
Nov 02 14:07:33.754170 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:07:33.754133    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09b26bf7_8c83_4188_b3b9_c03ef05491bc.slice/crio-a2cfe1e30e662e142791092716d8208afb00d57d331fce639ed00e9c02bcaa54 WatchSource:0}: Error finding container a2cfe1e30e662e142791092716d8208afb00d57d331fce639ed00e9c02bcaa54: Status 404 returned error can't find the container with id a2cfe1e30e662e142791092716d8208afb00d57d331fce639ed00e9c02bcaa54
Nov 02 14:07:33.884160 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:33.883660    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:34.674784 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:34.674745    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt" event={"ID":"09b26bf7-8c83-4188-b3b9-c03ef05491bc","Type":"ContainerStarted","Data":"0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db"}
Nov 02 14:07:34.674784 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:34.674792    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt" event={"ID":"09b26bf7-8c83-4188-b3b9-c03ef05491bc","Type":"ContainerStarted","Data":"a2cfe1e30e662e142791092716d8208afb00d57d331fce639ed00e9c02bcaa54"}
Nov 02 14:07:34.700979 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:34.700915    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt" podStartSLOduration=1.700892857 podStartE2EDuration="1.700892857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:07:34.698946895 +0000 UTC m=+1433.780092015" watchObservedRunningTime="2026-11-02 14:07:34.700892857 +0000 UTC m=+1433.782037977"
Nov 02 14:07:34.886329 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:34.886297    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:35.460800 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:35.460743    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:35.960013 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:35.959975    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:36.086363 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:07:36.086320    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:07:36.941738 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:36.941693    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:37.877774 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:37.877693    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:39.007950 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:39.007908    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:39.844828 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:39.844781    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:40.707704 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:40.707666    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:41.577211 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:41.577171    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:42.354579 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:42.354548    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:43.146859 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:43.146829    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:43.461122 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:43.460993    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:43.474093 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:43.474036    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:43.740745 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:43.740666    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:07:43.860289 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:43.860251    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:44.655208 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:44.655180    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:45.454006 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:45.453973    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:46.393213 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:46.393183    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:47.214635 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:47.214598    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:48.153103 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:48.153026    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:48.973718 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:48.973684    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:49.747536 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:49.747410    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:50.588092 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:50.587918    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:51.468420 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:51.468363    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:52.252756 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:52.252707    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:53.051992 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:53.051941    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:53.361681 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:53.361578    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:53.848430 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:53.848392    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:54.667547 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:54.667510    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:55.481639 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:55.481604    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:56.353735 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:56.353687    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:57.175917 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:57.175880    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:57.985317 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:57.985282    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:59.024732 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:59.024687    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:07:59.852854 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:07:59.852819    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:00.849911 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:00.849880    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:01.574431 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:01.574393    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:02.399886 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:02.399840    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:03.312632 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:03.312596    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:04.084290 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:04.084251    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:04.859775 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:04.859728    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:05.659661 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:05.659631    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:06.082955 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:08:06.082911    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:08:06.374905 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:06.374790    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:07.302492 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:07.302456    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:08.072896 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:08.072844    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:08.880101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:08.880041    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:09.661464 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:09.661431    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:10.488052 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:10.488011    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:11.272227 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:11.272185    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:12.139558 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:12.139525    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:12.996514 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:12.996483    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:13.450616 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:13.450580    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:13.874843 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:13.874808    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:14.769869 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:14.769826    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:15.774317 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:15.774272    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:16.667046 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:16.667013    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:17.513569 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:17.513526    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:18.377852 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:18.377811    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:18.384891 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:18.384855    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"]
Nov 02 14:08:18.606087 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:18.606045    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:19.191010 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:19.190978    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:19.969510 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:19.969468    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:20.816312 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:20.816279    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:21.678284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:21.678250    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:22.453888 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:22.453858    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:23.172518 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:23.172491    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:23.998968 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:23.998938    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:24.197924 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:24.197889    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:24.570745 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:24.570701    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:24.923395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:24.923268    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:25.148303 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:25.148262    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:25.496524 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:25.496493    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:32.038310 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:32.038278    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:32.195463 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:32.195429    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:32.427412 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:32.427301    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:33.406572 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.406525    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt" podUID="09b26bf7-8c83-4188-b3b9-c03ef05491bc" containerName="main" containerID="cri-o://0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db" gracePeriod=45
Nov 02 14:08:33.681248 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.681217    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:08:33.707945 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.707907    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-model-cache\") pod \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") "
Nov 02 14:08:33.708193 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.707994    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-home\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-home\") pod \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") "
Nov 02 14:08:33.708193 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.708029    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tls-certs\" (UniqueName: \"kubernetes.io/secret/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tls-certs\") pod \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") "
Nov 02 14:08:33.708193 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.708062    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09b26bf7-8c83-4188-b3b9-c03ef05491bc-kube-api-access-z7mrt\" (UniqueName: \"kubernetes.io/projected/09b26bf7-8c83-4188-b3b9-c03ef05491bc-kube-api-access-z7mrt\") pod \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") "
Nov 02 14:08:33.708193 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.708139    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-dshm\") pod \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") "
Nov 02 14:08:33.708193 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.708172    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tmp-dir\") pod \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\" (UID: \"09b26bf7-8c83-4188-b3b9-c03ef05491bc\") "
Nov 02 14:08:33.708427 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.708356    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-home" pod "09b26bf7-8c83-4188-b3b9-c03ef05491bc" (UID: "09b26bf7-8c83-4188-b3b9-c03ef05491bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:08:33.709236 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.708648    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:08:33.709236 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.708768    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tmp-dir" pod "09b26bf7-8c83-4188-b3b9-c03ef05491bc" (UID: "09b26bf7-8c83-4188-b3b9-c03ef05491bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:08:33.709236 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.709050    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-model-cache" pod "09b26bf7-8c83-4188-b3b9-c03ef05491bc" (UID: "09b26bf7-8c83-4188-b3b9-c03ef05491bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:08:33.711026 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.710992    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tls-certs" pod "09b26bf7-8c83-4188-b3b9-c03ef05491bc" (UID: "09b26bf7-8c83-4188-b3b9-c03ef05491bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:08:33.711428 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.711386    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09b26bf7-8c83-4188-b3b9-c03ef05491bc-kube-api-access-z7mrt" pod "09b26bf7-8c83-4188-b3b9-c03ef05491bc" (UID: "09b26bf7-8c83-4188-b3b9-c03ef05491bc"). InnerVolumeSpecName "kube-api-access-z7mrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:08:33.711629 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.711601    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-dshm" pod "09b26bf7-8c83-4188-b3b9-c03ef05491bc" (UID: "09b26bf7-8c83-4188-b3b9-c03ef05491bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:08:33.809635 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.809599    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:08:33.809635 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.809630    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7mrt\" (UniqueName: \"kubernetes.io/projected/09b26bf7-8c83-4188-b3b9-c03ef05491bc-kube-api-access-z7mrt\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:08:33.809635 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.809641    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:08:33.809898 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.809651    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:08:33.809898 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:33.809659    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09b26bf7-8c83-4188-b3b9-c03ef05491bc-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:08:34.001884 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.001795    5453 generic.go:356] "Generic (PLEG): container finished" podID="09b26bf7-8c83-4188-b3b9-c03ef05491bc" containerID="0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db" exitCode=0
Nov 02 14:08:34.001884 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.001871    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"
Nov 02 14:08:34.002147 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.001888    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt" event={"ID":"09b26bf7-8c83-4188-b3b9-c03ef05491bc","Type":"ContainerDied","Data":"0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db"}
Nov 02 14:08:34.002147 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.001933    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt" event={"ID":"09b26bf7-8c83-4188-b3b9-c03ef05491bc","Type":"ContainerDied","Data":"a2cfe1e30e662e142791092716d8208afb00d57d331fce639ed00e9c02bcaa54"}
Nov 02 14:08:34.002147 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.001950    5453 scope.go:122] "RemoveContainer" containerID="0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db"
Nov 02 14:08:34.018601 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.014373    5453 scope.go:122] "RemoveContainer" containerID="0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db"
Nov 02 14:08:34.019316 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:08:34.019170    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db\": container with ID starting with 0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db not found: ID does not exist" containerID="0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db"
Nov 02 14:08:34.019316 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.019222    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db"} err="failed to get container status \"0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db\": rpc error: code = NotFound desc = could not find container \"0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db\": container with ID starting with 0c797ff85ba4ec120d42bfaa8a6de13f47b105d88f7fc5d0210b96b60f4e32db not found: ID does not exist"
Nov 02 14:08:34.026859 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.026827    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"]
Nov 02 14:08:34.031122 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:34.031086    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-0c51da/simulator-single-main-0c51da-kserve-fd769f858-sgsbt"]
Nov 02 14:08:35.043610 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:35.043567    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09b26bf7-8c83-4188-b3b9-c03ef05491bc" path="/var/lib/kubelet/pods/09b26bf7-8c83-4188-b3b9-c03ef05491bc/volumes"
Nov 02 14:08:36.084502 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:08:36.084464    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:08:53.282721 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:53.282683    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:54.691589 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:54.691553    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:08:57.687963 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:08:57.687928    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:09:03.854428 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:03.854396    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:09:06.083589 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:09:06.083554    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:09:11.589226 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.589195    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"]
Nov 02 14:09:11.589762 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.589499    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b" podUID="b58158f9-1894-4e70-bf93-450729b83833" containerName="manager" containerID="cri-o://afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552" gracePeriod=10
Nov 02 14:09:11.838729 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.838700    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 14:09:11.865202 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.865107    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b58158f9-1894-4e70-bf93-450729b83833-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58158f9-1894-4e70-bf93-450729b83833-extensions-socket-volume\") pod \"b58158f9-1894-4e70-bf93-450729b83833\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") "
Nov 02 14:09:11.865202 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.865160    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b58158f9-1894-4e70-bf93-450729b83833-kube-api-access-q5dx4\" (UniqueName: \"kubernetes.io/projected/b58158f9-1894-4e70-bf93-450729b83833-kube-api-access-q5dx4\") pod \"b58158f9-1894-4e70-bf93-450729b83833\" (UID: \"b58158f9-1894-4e70-bf93-450729b83833\") "
Nov 02 14:09:11.865589 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.865557    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58158f9-1894-4e70-bf93-450729b83833-extensions-socket-volume" pod "b58158f9-1894-4e70-bf93-450729b83833" (UID: "b58158f9-1894-4e70-bf93-450729b83833"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:09:11.868012 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.867983    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58158f9-1894-4e70-bf93-450729b83833-kube-api-access-q5dx4" pod "b58158f9-1894-4e70-bf93-450729b83833" (UID: "b58158f9-1894-4e70-bf93-450729b83833"). InnerVolumeSpecName "kube-api-access-q5dx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:09:11.966510 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.966468    5453 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58158f9-1894-4e70-bf93-450729b83833-extensions-socket-volume\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:09:11.966510 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:11.966504    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5dx4\" (UniqueName: \"kubernetes.io/projected/b58158f9-1894-4e70-bf93-450729b83833-kube-api-access-q5dx4\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:09:12.198091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.197962    5453 generic.go:356] "Generic (PLEG): container finished" podID="b58158f9-1894-4e70-bf93-450729b83833" containerID="afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552" exitCode=0
Nov 02 14:09:12.198091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.198007    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b" event={"ID":"b58158f9-1894-4e70-bf93-450729b83833","Type":"ContainerDied","Data":"afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552"}
Nov 02 14:09:12.198091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.198020    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"
Nov 02 14:09:12.198091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.198054    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b" event={"ID":"b58158f9-1894-4e70-bf93-450729b83833","Type":"ContainerDied","Data":"f7cc17cd347e23dcfa7858d83d19771fb080180fc2ef2f9b7ddc31314df9089e"}
Nov 02 14:09:12.198439 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.198117    5453 scope.go:122] "RemoveContainer" containerID="afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552"
Nov 02 14:09:12.209310 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.209292    5453 scope.go:122] "RemoveContainer" containerID="afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552"
Nov 02 14:09:12.209635 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:09:12.209609    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552\": container with ID starting with afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552 not found: ID does not exist" containerID="afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552"
Nov 02 14:09:12.209689 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.209646    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552"} err="failed to get container status \"afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552\": rpc error: code = NotFound desc = could not find container \"afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552\": container with ID starting with afce45019f85b9893d6fff2580048100eedb281bb17eaaba627dfde50ad02552 not found: ID does not exist"
Nov 02 14:09:12.221498 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.221440    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"]
Nov 02 14:09:12.226749 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:12.226717    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-2wm5b"]
Nov 02 14:09:13.042191 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:13.042160    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b58158f9-1894-4e70-bf93-450729b83833" path="/var/lib/kubelet/pods/b58158f9-1894-4e70-bf93-450729b83833/volumes"
Nov 02 14:09:19.101818 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:19.101782    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:09:36.083945 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:09:36.083909    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:09:53.319280 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:09:53.319245    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:10:06.083491 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:10:06.083446    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:10:07.361025 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:07.360994    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:10:07.501495 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:07.501461    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:10:12.706346 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706299    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"]
Nov 02 14:10:12.706772 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706671    5453 cpu_manager.go:414] "containerMap: removing container" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy"
Nov 02 14:10:12.706772 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706686    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy"
Nov 02 14:10:12.706772 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706733    5453 cpu_manager.go:414] "containerMap: removing container" podUID="09b26bf7-8c83-4188-b3b9-c03ef05491bc" containerName="main"
Nov 02 14:10:12.706772 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706739    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09b26bf7-8c83-4188-b3b9-c03ef05491bc" containerName="main"
Nov 02 14:10:12.706772 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706749    5453 cpu_manager.go:414] "containerMap: removing container" podUID="b58158f9-1894-4e70-bf93-450729b83833" containerName="manager"
Nov 02 14:10:12.706772 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706754    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b58158f9-1894-4e70-bf93-450729b83833" containerName="manager"
Nov 02 14:10:12.706959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706815    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c8c17a4-0eab-420d-9d21-90bf56768a59" containerName="cleanup"
Nov 02 14:10:12.706959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706823    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="09b26bf7-8c83-4188-b3b9-c03ef05491bc" containerName="main"
Nov 02 14:10:12.706959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706829    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="b58158f9-1894-4e70-bf93-450729b83833" containerName="manager"
Nov 02 14:10:12.706959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.706836    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4fa0fe4-2e64-45ba-95d2-b75d67d28688" containerName="istio-proxy"
Nov 02 14:10:12.710014 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.709995    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:12.716890 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.716580    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-72vml\""
Nov 02 14:10:12.724204 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.724172    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"]
Nov 02 14:10:12.819365 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.819314    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af0b4a8a-f5ce-4b88-ba59-e973c6163b50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-gd2fx\" (UID: \"af0b4a8a-f5ce-4b88-ba59-e973c6163b50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:12.819365 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.819366    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnljz\" (UniqueName: \"kubernetes.io/projected/af0b4a8a-f5ce-4b88-ba59-e973c6163b50-kube-api-access-hnljz\") pod \"kuadrant-operator-controller-manager-678d87766f-gd2fx\" (UID: \"af0b4a8a-f5ce-4b88-ba59-e973c6163b50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:12.920357 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.920301    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af0b4a8a-f5ce-4b88-ba59-e973c6163b50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-gd2fx\" (UID: \"af0b4a8a-f5ce-4b88-ba59-e973c6163b50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:12.920357 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.920356    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnljz\" (UniqueName: \"kubernetes.io/projected/af0b4a8a-f5ce-4b88-ba59-e973c6163b50-kube-api-access-hnljz\") pod \"kuadrant-operator-controller-manager-678d87766f-gd2fx\" (UID: \"af0b4a8a-f5ce-4b88-ba59-e973c6163b50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:12.920715 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.920697    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af0b4a8a-f5ce-4b88-ba59-e973c6163b50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-gd2fx\" (UID: \"af0b4a8a-f5ce-4b88-ba59-e973c6163b50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:12.934112 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:12.934062    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnljz\" (UniqueName: \"kubernetes.io/projected/af0b4a8a-f5ce-4b88-ba59-e973c6163b50-kube-api-access-hnljz\") pod \"kuadrant-operator-controller-manager-678d87766f-gd2fx\" (UID: \"af0b4a8a-f5ce-4b88-ba59-e973c6163b50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:13.023649 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:13.023558    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:13.315091 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:13.315033    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"]
Nov 02 14:10:13.318637 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:10:13.318598    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0b4a8a_f5ce_4b88_ba59_e973c6163b50.slice/crio-3c0b78d9c4a0f9b6b1ff6812410c73f6a56328646faca926ae091a6943f5c370 WatchSource:0}: Error finding container 3c0b78d9c4a0f9b6b1ff6812410c73f6a56328646faca926ae091a6943f5c370: Status 404 returned error can't find the container with id 3c0b78d9c4a0f9b6b1ff6812410c73f6a56328646faca926ae091a6943f5c370
Nov 02 14:10:13.508729 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:13.508682    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx" event={"ID":"af0b4a8a-f5ce-4b88-ba59-e973c6163b50","Type":"ContainerStarted","Data":"8d37fe682402b1cdb24f2bfee1faf771935d8e9e788c52da0139be87b754bfc5"}
Nov 02 14:10:13.508905 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:13.508751    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx" event={"ID":"af0b4a8a-f5ce-4b88-ba59-e973c6163b50","Type":"ContainerStarted","Data":"3c0b78d9c4a0f9b6b1ff6812410c73f6a56328646faca926ae091a6943f5c370"}
Nov 02 14:10:13.508905 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:13.508782    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:13.534611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:13.534564    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx" podStartSLOduration=1.534547834 podStartE2EDuration="1.534547834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:10:13.533262528 +0000 UTC m=+1592.614407649" watchObservedRunningTime="2026-11-02 14:10:13.534547834 +0000 UTC m=+1592.615692954"
Nov 02 14:10:24.516169 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:24.516134    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-gd2fx"
Nov 02 14:10:36.083904 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:10:36.083859    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:10:53.402409 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:53.402318    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:10:57.759595 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:57.759558    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:10:58.031083 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:10:58.031019    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:06.084813 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:11:06.084767    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:11:06.850835 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:06.850796    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:07.329629 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:07.329580    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:07.515608 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:07.515571    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:10.891438 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:10.891374    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:11.039413 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:11.039361    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:12.186677 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:12.186643    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:12.321408 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:12.321369    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:12.556457 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:12.556427    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:13.071266 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:13.071232    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:13.954695 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:13.954654    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:14.970323 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:14.970234    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:15.763636 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:15.763597    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:16.548718 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:16.548672    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:17.295192 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:17.295153    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:18.064807 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:18.064760    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:19.067250 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:19.067213    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:20.022987 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:20.022957    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:20.809405 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:20.809374    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:21.576981 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:21.576932    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:22.374141 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:22.374096    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:23.150202 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:23.150168    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:23.848586 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:23.848543    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:24.799134 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:24.799056    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:25.678892 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:25.678844    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:25.861626 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:25.861590    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:26.497264 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:26.497232    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:26.648423 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:26.648389    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:26.856404 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:26.856372    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:28.011458 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.011423    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"]
Nov 02 14:11:28.015350 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.015307    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.019808 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.019776    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:28.032085 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.032021    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-7346d7\"/\"openshift-service-ca.crt\""
Nov 02 14:11:28.032283 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.032202    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-7346d7\"/\"simulator-single-main-7346d7-kserve-self-signed-certs\""
Nov 02 14:11:28.032283 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.032276    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-7346d7\"/\"default-dockercfg-npcqm\""
Nov 02 14:11:28.032398 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.032368    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-7346d7\"/\"kube-root-ca.crt\""
Nov 02 14:11:28.032494 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.032467    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"]
Nov 02 14:11:28.161608 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.161564    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-tmp-dir\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.161929 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.161909    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-dshm\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.162024 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.161935    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-model-cache\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.162024 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.162003    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824c4dfe-7a1f-4287-92d6-689380c73962-tls-certs\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.162157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.162044    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-home\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.162268 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.162238    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddjj\" (UniqueName: \"kubernetes.io/projected/824c4dfe-7a1f-4287-92d6-689380c73962-kube-api-access-xddjj\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.210972 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.210931    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:28.263451 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263358    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-tmp-dir\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.263451 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263412    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-dshm\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.263451 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263443    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-model-cache\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.263822 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263462    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824c4dfe-7a1f-4287-92d6-689380c73962-tls-certs\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.263822 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263480    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-home\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.263822 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263513    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddjj\" (UniqueName: \"kubernetes.io/projected/824c4dfe-7a1f-4287-92d6-689380c73962-kube-api-access-xddjj\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.263976 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263894    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-tmp-dir\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.263976 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.263906    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-model-cache\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.264102 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.264043    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-home\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.266308 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.266283    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-dshm\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.266710 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.266682    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824c4dfe-7a1f-4287-92d6-689380c73962-tls-certs\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.276837 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.276775    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddjj\" (UniqueName: \"kubernetes.io/projected/824c4dfe-7a1f-4287-92d6-689380c73962-kube-api-access-xddjj\") pod \"simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") " pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.329942 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.329899    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:28.614251 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.614222    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"]
Nov 02 14:11:28.617594 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:11:28.617555    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod824c4dfe_7a1f_4287_92d6_689380c73962.slice/crio-da7c20aa6577f3cd6dd02fe302a53a5d424b6bb915fc00b91810502c6fc77436 WatchSource:0}: Error finding container da7c20aa6577f3cd6dd02fe302a53a5d424b6bb915fc00b91810502c6fc77436: Status 404 returned error can't find the container with id da7c20aa6577f3cd6dd02fe302a53a5d424b6bb915fc00b91810502c6fc77436
Nov 02 14:11:28.899676 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.899584    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:28.942420 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.942376    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t" event={"ID":"824c4dfe-7a1f-4287-92d6-689380c73962","Type":"ContainerStarted","Data":"99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083"}
Nov 02 14:11:28.942420 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.942424    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t" event={"ID":"824c4dfe-7a1f-4287-92d6-689380c73962","Type":"ContainerStarted","Data":"da7c20aa6577f3cd6dd02fe302a53a5d424b6bb915fc00b91810502c6fc77436"}
Nov 02 14:11:28.963404 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:28.963341    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t" podStartSLOduration=1.963310834 podStartE2EDuration="1.963310834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:11:28.96296895 +0000 UTC m=+1668.044114077" watchObservedRunningTime="2026-11-02 14:11:28.963310834 +0000 UTC m=+1668.044455961"
Nov 02 14:11:29.330654 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:29.330614    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:29.777032 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:29.776931    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:30.705111 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:30.704011    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:31.646330 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:31.646291    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:32.453487 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:32.453444    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:33.209479 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:33.209428    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:34.052751 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:34.052718    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:34.758328 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:34.758290    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:35.550532 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:35.550491    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:36.084428 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:11:36.084390    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:11:36.264636 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:36.264599    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:37.006320 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:37.006278    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:37.698455 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:37.698374    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:38.330320 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:38.330267    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:38.342931 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:38.342905    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:38.492948 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:38.492910    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:39.011443 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:39.011411    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:11:39.284341 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:39.284303    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:40.067501 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:40.067461    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:40.972192 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:40.972160    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:41.753841 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:41.753809    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:42.485256 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:42.485216    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:43.299315 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:43.299278    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:44.189648 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:44.189611    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:45.091170 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:45.091139    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:45.992970 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:45.992934    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:46.745572 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:46.745536    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:47.554142 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:47.554059    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:48.347769 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:48.347730    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:49.183485 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:49.183446    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:50.097708 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:50.097673    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:50.886105 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:50.886056    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:51.765694 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:51.765657    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:52.548058 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:52.548025    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:53.368021 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:53.367971    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:53.526283 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:53.526247    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:54.096670 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:54.096636    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:54.987259 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:54.987225    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:55.871848 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:55.871815    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:56.564482 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:56.564434    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:57.342962 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:57.342931    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:58.279401 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:58.279364    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:11:59.200306 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:11:59.200263    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:00.111618 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:00.111590    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:00.813751 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:00.813711    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:01.592179 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:01.592137    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:02.497930 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:02.497889    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:03.205701 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:03.205631    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:03.953155 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:03.953125    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:04.810423 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:04.810383    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:05.465837 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:05.465808    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:06.084615 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:12:06.084579    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:12:06.155864 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:06.155831    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:06.854140 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:06.854095    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:07.564555 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:07.564515    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:08.365451 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:08.365410    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:09.181565 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:09.181530    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:09.934476 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:09.934434    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:10.699499 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:10.699451    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:11.818370 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:11.818311    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:12.561472 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:12.561436    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:13.354222 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:13.354189    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:14.119744 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:14.119701    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:14.945481 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:14.945437    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:15.658319 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:15.658280    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:16.483238 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:16.483203    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:17.272731 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:17.272691    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:18.069853 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:18.069819    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:18.759890 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:18.759828    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:19.448607 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:19.448574    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:20.273287 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:20.273241    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:20.906393 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:20.906350    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:21.078685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:21.078653    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:21.773481 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:21.773385    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:22.659682 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:22.659646    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:23.361804 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:23.361770    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:24.062466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:24.062432    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:24.767976 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:24.767940    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:25.440717 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:25.440682    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:25.831627 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:25.831536    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"]
Nov 02 14:12:25.935512 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:25.935477    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:27.666219 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:27.666178    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:28.450423 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:28.450388    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:29.152663 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:29.152628    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:30.043187 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:30.043154    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:30.758398 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:30.758364    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:31.292131 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:31.292055    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:31.432246 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:31.432206    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:32.148924 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:32.148886    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:32.368686 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:32.368638    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:32.825752 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:32.825695    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:36.082818 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:12:36.082776    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:12:38.977388 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:38.977318    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:39.125110 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:39.125061    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:39.346997 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:39.346957    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:40.853271 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:40.853203    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t" podUID="824c4dfe-7a1f-4287-92d6-689380c73962" containerName="main" containerID="cri-o://99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083" gracePeriod=45
Nov 02 14:12:41.000961 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.000912    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t" podUID="824c4dfe-7a1f-4287-92d6-689380c73962" containerName="main" probeResult="failure" output="Get \"https://10.133.0.93:8000/ready\": dial tcp 10.133.0.93:8000: connect: connection refused"
Nov 02 14:12:41.110418 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.110344    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:12:41.172562 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172520    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-home\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-home\") pod \"824c4dfe-7a1f-4287-92d6-689380c73962\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") "
Nov 02 14:12:41.172757 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172584    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/824c4dfe-7a1f-4287-92d6-689380c73962-kube-api-access-xddjj\" (UniqueName: \"kubernetes.io/projected/824c4dfe-7a1f-4287-92d6-689380c73962-kube-api-access-xddjj\") pod \"824c4dfe-7a1f-4287-92d6-689380c73962\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") "
Nov 02 14:12:41.172757 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172627    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-tmp-dir\") pod \"824c4dfe-7a1f-4287-92d6-689380c73962\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") "
Nov 02 14:12:41.172757 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172674    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/824c4dfe-7a1f-4287-92d6-689380c73962-tls-certs\" (UniqueName: \"kubernetes.io/secret/824c4dfe-7a1f-4287-92d6-689380c73962-tls-certs\") pod \"824c4dfe-7a1f-4287-92d6-689380c73962\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") "
Nov 02 14:12:41.172757 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172750    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-dshm\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-dshm\") pod \"824c4dfe-7a1f-4287-92d6-689380c73962\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") "
Nov 02 14:12:41.172987 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172807    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-model-cache\") pod \"824c4dfe-7a1f-4287-92d6-689380c73962\" (UID: \"824c4dfe-7a1f-4287-92d6-689380c73962\") "
Nov 02 14:12:41.172987 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172808    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-home" pod "824c4dfe-7a1f-4287-92d6-689380c73962" (UID: "824c4dfe-7a1f-4287-92d6-689380c73962"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:12:41.172987 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.172969    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-tmp-dir" pod "824c4dfe-7a1f-4287-92d6-689380c73962" (UID: "824c4dfe-7a1f-4287-92d6-689380c73962"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:12:41.173219 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.173201    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:12:41.173282 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.173223    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:12:41.173426 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.173400    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-model-cache" pod "824c4dfe-7a1f-4287-92d6-689380c73962" (UID: "824c4dfe-7a1f-4287-92d6-689380c73962"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:12:41.175792 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.175747    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-dshm" pod "824c4dfe-7a1f-4287-92d6-689380c73962" (UID: "824c4dfe-7a1f-4287-92d6-689380c73962"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:12:41.175962 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.175920    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824c4dfe-7a1f-4287-92d6-689380c73962-kube-api-access-xddjj" pod "824c4dfe-7a1f-4287-92d6-689380c73962" (UID: "824c4dfe-7a1f-4287-92d6-689380c73962"). InnerVolumeSpecName "kube-api-access-xddjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:12:41.176170 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.176128    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824c4dfe-7a1f-4287-92d6-689380c73962-tls-certs" pod "824c4dfe-7a1f-4287-92d6-689380c73962" (UID: "824c4dfe-7a1f-4287-92d6-689380c73962"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:12:41.274234 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.274194    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:12:41.274234 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.274226    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824c4dfe-7a1f-4287-92d6-689380c73962-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:12:41.274234 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.274237    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xddjj\" (UniqueName: \"kubernetes.io/projected/824c4dfe-7a1f-4287-92d6-689380c73962-kube-api-access-xddjj\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:12:41.274234 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.274246    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824c4dfe-7a1f-4287-92d6-689380c73962-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:12:41.328182 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.328143    5453 generic.go:356] "Generic (PLEG): container finished" podID="824c4dfe-7a1f-4287-92d6-689380c73962" containerID="99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083" exitCode=0
Nov 02 14:12:41.328361 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.328201    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"
Nov 02 14:12:41.328361 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.328199    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t" event={"ID":"824c4dfe-7a1f-4287-92d6-689380c73962","Type":"ContainerDied","Data":"99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083"}
Nov 02 14:12:41.328361 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.328314    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t" event={"ID":"824c4dfe-7a1f-4287-92d6-689380c73962","Type":"ContainerDied","Data":"da7c20aa6577f3cd6dd02fe302a53a5d424b6bb915fc00b91810502c6fc77436"}
Nov 02 14:12:41.328361 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.328337    5453 scope.go:122] "RemoveContainer" containerID="99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083"
Nov 02 14:12:41.340608 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.340586    5453 scope.go:122] "RemoveContainer" containerID="99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083"
Nov 02 14:12:41.340982 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:12:41.340954    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083\": container with ID starting with 99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083 not found: ID does not exist" containerID="99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083"
Nov 02 14:12:41.341114 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.340987    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083"} err="failed to get container status \"99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083\": rpc error: code = NotFound desc = could not find container \"99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083\": container with ID starting with 99ec7a14c03cef6ca7a34cf2af1c8bf89a7fa179c61af7a5a1ca2e70bd5b8083 not found: ID does not exist"
Nov 02 14:12:41.355232 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.355197    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"]
Nov 02 14:12:41.361156 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:41.361077    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-7346d7/simulator-single-main-7346d7-kserve-6867c7cd9f-xbf5t"]
Nov 02 14:12:43.042410 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:43.042374    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="824c4dfe-7a1f-4287-92d6-689380c73962" path="/var/lib/kubelet/pods/824c4dfe-7a1f-4287-92d6-689380c73962/volumes"
Nov 02 14:12:53.502969 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:53.502932    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:55.467284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.467244    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"]
Nov 02 14:12:55.467734 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.467625    5453 cpu_manager.go:414] "containerMap: removing container" podUID="824c4dfe-7a1f-4287-92d6-689380c73962" containerName="main"
Nov 02 14:12:55.467734 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.467637    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="824c4dfe-7a1f-4287-92d6-689380c73962" containerName="main"
Nov 02 14:12:55.467734 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.467716    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="824c4dfe-7a1f-4287-92d6-689380c73962" containerName="main"
Nov 02 14:12:55.472495 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.472469    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.482506 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.482475    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 02 14:12:55.482761 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.482501    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 02 14:12:55.482761 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.482637    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-be499ab0-kserve-self-signed-certs\""
Nov 02 14:12:55.482761 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.482757    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lwlfp\""
Nov 02 14:12:55.484663 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.484635    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"]
Nov 02 14:12:55.549571 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.549523    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:12:55.620471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.620434    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-model-cache\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.620471 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.620484    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-dshm\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.620754 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.620615    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tmp-dir\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.620819 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.620756    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-home\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.620900 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.620870    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tls-certs\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.620955 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.620921    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dznx6\" (UniqueName: \"kubernetes.io/projected/a085b7a9-92be-4a8a-b793-aed5d0f9b068-kube-api-access-dznx6\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.722205 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.722056    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-model-cache\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.722205 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.722140    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-dshm\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.722205 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.722160    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tmp-dir\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.722515 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.722216    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-home\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.722515 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.722253    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tls-certs\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.722515 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.722273    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dznx6\" (UniqueName: \"kubernetes.io/projected/a085b7a9-92be-4a8a-b793-aed5d0f9b068-kube-api-access-dznx6\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.723005 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.722975    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-model-cache\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.723191 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.723091    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tmp-dir\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.723191 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.723119    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-home\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.725279 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.725247    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-dshm\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.725466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.725444    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tls-certs\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.736623 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.736591    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dznx6\" (UniqueName: \"kubernetes.io/projected/a085b7a9-92be-4a8a-b793-aed5d0f9b068-kube-api-access-dznx6\") pod \"e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") " pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:55.791464 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:55.791420    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:12:56.097023 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:56.096985    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"]
Nov 02 14:12:56.102437 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:12:56.102390    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda085b7a9_92be_4a8a_b793_aed5d0f9b068.slice/crio-9f19e476cbf29605a73f6c54e9fc8d85e6c9a20b305b4c28a2ac471f4a7371bb WatchSource:0}: Error finding container 9f19e476cbf29605a73f6c54e9fc8d85e6c9a20b305b4c28a2ac471f4a7371bb: Status 404 returned error can't find the container with id 9f19e476cbf29605a73f6c54e9fc8d85e6c9a20b305b4c28a2ac471f4a7371bb
Nov 02 14:12:56.416633 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:56.416538    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt" event={"ID":"a085b7a9-92be-4a8a-b793-aed5d0f9b068","Type":"ContainerStarted","Data":"db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4"}
Nov 02 14:12:56.416633 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:56.416582    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt" event={"ID":"a085b7a9-92be-4a8a-b793-aed5d0f9b068","Type":"ContainerStarted","Data":"9f19e476cbf29605a73f6c54e9fc8d85e6c9a20b305b4c28a2ac471f4a7371bb"}
Nov 02 14:12:56.437840 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:56.437773    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt" podStartSLOduration=1.437752799 podStartE2EDuration="1.437752799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:12:56.437414663 +0000 UTC m=+1755.518559785" watchObservedRunningTime="2026-11-02 14:12:56.437752799 +0000 UTC m=+1755.518897920"
Nov 02 14:12:56.791902 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:12:56.791859    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:13:00.869129 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:00.869056    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 14:13:00.869604 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:00.869163    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:13:02.417486 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:02.417427    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:03.995550 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:03.995507    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:05.792128 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:05.792088    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:13:05.804597 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:05.804566    5453 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:13:06.083447 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:13:06.083287    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:13:06.497786 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:06.497704    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:13:08.086227 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:08.086194    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:10.081284 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:10.081219    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:10.303393 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:10.303360    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:30.892095 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:30.891177    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 14:13:30.892095 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:30.891249    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:13:36.083882 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:13:36.083841    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:13:37.730664 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:37.730623    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"]
Nov 02 14:13:37.898692 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:37.898651    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:38.032817 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:38.032786    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:39.560507 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:39.560466    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:42.465098 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:42.461205    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 14:13:42.465098 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:42.461278    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:13:42.767226 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:42.767120    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 14:13:42.767517 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:42.767485    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-jlgxm" podUID="d44a11c9-7eec-4447-8899-5df89d8c9923" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:13:45.894242 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:45.894198    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 14:13:45.894899 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:45.894861    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-hw5qn" podUID="e8b648f5-c74b-456d-a0f5-8421e4afb536" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:13:52.777874 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:52.777586    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt" podUID="a085b7a9-92be-4a8a-b793-aed5d0f9b068" containerName="main" containerID="cri-o://db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4" gracePeriod=45
Nov 02 14:13:53.343095 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.337578    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:13:53.522121 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.521981    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-dshm\") pod \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") "
Nov 02 14:13:53.522121 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.522051    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-home\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-home\") pod \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") "
Nov 02 14:13:53.522400 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.522149    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a085b7a9-92be-4a8a-b793-aed5d0f9b068-kube-api-access-dznx6\" (UniqueName: \"kubernetes.io/projected/a085b7a9-92be-4a8a-b793-aed5d0f9b068-kube-api-access-dznx6\") pod \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") "
Nov 02 14:13:53.522400 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.522184    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tls-certs\" (UniqueName: \"kubernetes.io/secret/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tls-certs\") pod \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") "
Nov 02 14:13:53.522400 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.522223    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tmp-dir\") pod \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") "
Nov 02 14:13:53.522400 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.522299    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-model-cache\") pod \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\" (UID: \"a085b7a9-92be-4a8a-b793-aed5d0f9b068\") "
Nov 02 14:13:53.522783 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.522756    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-model-cache" pod "a085b7a9-92be-4a8a-b793-aed5d0f9b068" (UID: "a085b7a9-92be-4a8a-b793-aed5d0f9b068"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:13:53.523135 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.522937    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-home" pod "a085b7a9-92be-4a8a-b793-aed5d0f9b068" (UID: "a085b7a9-92be-4a8a-b793-aed5d0f9b068"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:13:53.523478 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.523457    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tmp-dir" pod "a085b7a9-92be-4a8a-b793-aed5d0f9b068" (UID: "a085b7a9-92be-4a8a-b793-aed5d0f9b068"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:13:53.524874 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.524850    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-dshm" pod "a085b7a9-92be-4a8a-b793-aed5d0f9b068" (UID: "a085b7a9-92be-4a8a-b793-aed5d0f9b068"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 02 14:13:53.526603 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.526562    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tls-certs" pod "a085b7a9-92be-4a8a-b793-aed5d0f9b068" (UID: "a085b7a9-92be-4a8a-b793-aed5d0f9b068"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:13:53.526835 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.526815    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a085b7a9-92be-4a8a-b793-aed5d0f9b068-kube-api-access-dznx6" pod "a085b7a9-92be-4a8a-b793-aed5d0f9b068" (UID: "a085b7a9-92be-4a8a-b793-aed5d0f9b068"). InnerVolumeSpecName "kube-api-access-dznx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:13:53.623327 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.623173    5453 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-dshm\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:13:53.623327 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.623215    5453 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-home\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:13:53.623327 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.623232    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dznx6\" (UniqueName: \"kubernetes.io/projected/a085b7a9-92be-4a8a-b793-aed5d0f9b068-kube-api-access-dznx6\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:13:53.623327 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.623250    5453 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tls-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:13:53.623327 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.623265    5453 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-tmp-dir\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:13:53.623327 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.623279    5453 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a085b7a9-92be-4a8a-b793-aed5d0f9b068-model-cache\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:13:53.703110 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.700755    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:13:53.867541 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.867488    5453 generic.go:356] "Generic (PLEG): container finished" podID="a085b7a9-92be-4a8a-b793-aed5d0f9b068" containerID="db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4" exitCode=0
Nov 02 14:13:53.868345 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.868301    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt" event={"ID":"a085b7a9-92be-4a8a-b793-aed5d0f9b068","Type":"ContainerDied","Data":"db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4"}
Nov 02 14:13:53.868555 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.868535    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt" event={"ID":"a085b7a9-92be-4a8a-b793-aed5d0f9b068","Type":"ContainerDied","Data":"9f19e476cbf29605a73f6c54e9fc8d85e6c9a20b305b4c28a2ac471f4a7371bb"}
Nov 02 14:13:53.868709 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.868691    5453 scope.go:122] "RemoveContainer" containerID="db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4"
Nov 02 14:13:53.869141 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.869124    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"
Nov 02 14:13:53.909515 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.909368    5453 scope.go:122] "RemoveContainer" containerID="db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4"
Nov 02 14:13:53.913395 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:13:53.913273    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4\": container with ID starting with db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4 not found: ID does not exist" containerID="db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4"
Nov 02 14:13:53.913395 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.913324    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4"} err="failed to get container status \"db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4\": rpc error: code = NotFound desc = could not find container \"db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4\": container with ID starting with db1920ab93a343e8f2b562ff59d0aac5e9e4f07c3ebac2815bad0471950afaf4 not found: ID does not exist"
Nov 02 14:13:53.932566 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.932530    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"]
Nov 02 14:13:53.975112 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:53.973256    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-be499ab0-kserve-6d96469bb5-s6fgt"]
Nov 02 14:13:55.045505 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:55.045458    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a085b7a9-92be-4a8a-b793-aed5d0f9b068" path="/var/lib/kubelet/pods/a085b7a9-92be-4a8a-b793-aed5d0f9b068/volumes"
Nov 02 14:13:57.459451 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:57.459403    5453 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 02 14:13:57.460156 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:13:57.460119    5453 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-bmx8h" podUID="f6c7276c-47b7-492f-8eb0-9c3d80797832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 02 14:14:02.485296 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:02.485261    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:06.083387 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:14:06.083348    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:14:13.468302 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.468255    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"]
Nov 02 14:14:13.468848 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.468785    5453 cpu_manager.go:414] "containerMap: removing container" podUID="a085b7a9-92be-4a8a-b793-aed5d0f9b068" containerName="main"
Nov 02 14:14:13.468848 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.468803    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a085b7a9-92be-4a8a-b793-aed5d0f9b068" containerName="main"
Nov 02 14:14:13.468949 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.468898    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="a085b7a9-92be-4a8a-b793-aed5d0f9b068" containerName="main"
Nov 02 14:14:13.472703 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.472666    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.484475 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.484430    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 02 14:14:13.484820 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.484790    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 02 14:14:13.484994 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.484790    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 02 14:14:13.485090 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.484434    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 02 14:14:13.485189 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.484795    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7dtkz\""
Nov 02 14:14:13.489033 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.488994    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"]
Nov 02 14:14:13.544700 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.544665    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-maas-api-tls\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.544700 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.544700    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-openshift-service-ca\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.544939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.544722    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m88l4\" (UniqueName: \"kubernetes.io/projected/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-kube-api-access-m88l4\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.544939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.544746    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-metrics-certs\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.645872 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.645827    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-maas-api-tls\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.645872 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.645869    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-openshift-service-ca\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.646209 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.645889    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88l4\" (UniqueName: \"kubernetes.io/projected/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-kube-api-access-m88l4\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.646209 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.645914    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-metrics-certs\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.646593 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.646565    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-openshift-service-ca\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.648668 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.648637    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-metrics-certs\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.648778 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.648691    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-maas-api-tls\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.659017 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.658987    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m88l4\" (UniqueName: \"kubernetes.io/projected/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-kube-api-access-m88l4\") pod \"maas-api-8d54bcbb-h8bwk\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:13.791350 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:13.791283    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:14.071827 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:14.071799    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"]
Nov 02 14:14:14.074081 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:14:14.074037    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7296d2ce_8bd6_4f53_a60c_41c2eb6a9580.slice/crio-9aa7b0a741ae6324eced60061cc06d38333bafaeddc769e463f991cc6507c978 WatchSource:0}: Error finding container 9aa7b0a741ae6324eced60061cc06d38333bafaeddc769e463f991cc6507c978: Status 404 returned error can't find the container with id 9aa7b0a741ae6324eced60061cc06d38333bafaeddc769e463f991cc6507c978
Nov 02 14:14:14.075545 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:14.075524    5453 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 02 14:14:14.998225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:14.998123    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk" event={"ID":"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580","Type":"ContainerStarted","Data":"efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a"}
Nov 02 14:14:14.998225 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:14.998217    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk" event={"ID":"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580","Type":"ContainerStarted","Data":"9aa7b0a741ae6324eced60061cc06d38333bafaeddc769e463f991cc6507c978"}
Nov 02 14:14:14.998707 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:14.998280    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:20.311763 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.311716    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:20.754591 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.754478    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:20.934544 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.934484    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk" podStartSLOduration=7.359784176 podStartE2EDuration="7.93446619s" totalImagesPullingTime="574.682014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:14:15.037300647 +0000 UTC m=+1834.118445768" watchObservedRunningTime="2026-11-02 14:14:20.93446619 +0000 UTC m=+1840.015611310"
Nov 02 14:14:20.935310 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.935288    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"]
Nov 02 14:14:20.935573 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.935547    5453 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk" podUID="7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" containerName="maas-api" containerID="cri-o://efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a" gracePeriod=30
Nov 02 14:14:20.941868 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.941838    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:20.981198 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.981162    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"]
Nov 02 14:14:20.985457 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:20.985427    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.004587 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.003804    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"]
Nov 02 14:14:21.015648 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.015554    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1574ed0f-3aea-4269-8338-ba112dcc402c-maas-api-tls\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.015797 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.015643    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1574ed0f-3aea-4269-8338-ba112dcc402c-openshift-service-ca\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.015797 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.015757    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1574ed0f-3aea-4269-8338-ba112dcc402c-metrics-certs\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.015927 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.015812    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqp4\" (UniqueName: \"kubernetes.io/projected/1574ed0f-3aea-4269-8338-ba112dcc402c-kube-api-access-pjqp4\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.043829 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.043788    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:21.117345 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.117306    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1574ed0f-3aea-4269-8338-ba112dcc402c-openshift-service-ca\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.117470 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.117374    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1574ed0f-3aea-4269-8338-ba112dcc402c-metrics-certs\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.117470 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.117416    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqp4\" (UniqueName: \"kubernetes.io/projected/1574ed0f-3aea-4269-8338-ba112dcc402c-kube-api-access-pjqp4\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.117580 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.117489    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1574ed0f-3aea-4269-8338-ba112dcc402c-maas-api-tls\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.118323 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.118292    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1574ed0f-3aea-4269-8338-ba112dcc402c-openshift-service-ca\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.121034 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.121003    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1574ed0f-3aea-4269-8338-ba112dcc402c-maas-api-tls\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.121186 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.121051    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1574ed0f-3aea-4269-8338-ba112dcc402c-metrics-certs\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.133493 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.133461    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqp4\" (UniqueName: \"kubernetes.io/projected/1574ed0f-3aea-4269-8338-ba112dcc402c-kube-api-access-pjqp4\") pod \"maas-api-556bc67b74-tlwn6\" (UID: \"1574ed0f-3aea-4269-8338-ba112dcc402c\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.192062 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.192024    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:21.218341 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.218304    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-metrics-certs\") pod \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") "
Nov 02 14:14:21.218531 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.218417    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-maas-api-tls\") pod \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") "
Nov 02 14:14:21.218531 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.218474    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-kube-api-access-m88l4\" (UniqueName: \"kubernetes.io/projected/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-kube-api-access-m88l4\") pod \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") "
Nov 02 14:14:21.218673 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.218576    5453 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-openshift-service-ca\") pod \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\" (UID: \"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580\") "
Nov 02 14:14:21.219115 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.219039    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-openshift-service-ca" pod "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" (UID: "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 02 14:14:21.221466 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.221427    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-metrics-certs" pod "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" (UID: "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:14:21.221644 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.221616    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-kube-api-access-m88l4" pod "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" (UID: "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580"). InnerVolumeSpecName "kube-api-access-m88l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 02 14:14:21.221731 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.221699    5453 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-maas-api-tls" pod "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" (UID: "7296d2ce-8bd6-4f53-a60c-41c2eb6a9580"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 02 14:14:21.320101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.320023    5453 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-maas-api-tls\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:14:21.320101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.320059    5453 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m88l4\" (UniqueName: \"kubernetes.io/projected/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-kube-api-access-m88l4\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:14:21.320101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.320102    5453 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-openshift-service-ca\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:14:21.320101 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.320111    5453 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580-metrics-certs\") on node \"ip-10-0-131-166.us-east-2.compute.internal\" DevicePath \"\""
Nov 02 14:14:21.335980 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.335936    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:21.617464 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:21.617386    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"]
Nov 02 14:14:21.620989 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:14:21.620960    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1574ed0f_3aea_4269_8338_ba112dcc402c.slice/crio-016f51783b7a921975d63225239e8d40db7b71e470a0bfead338ba66a3bc0776 WatchSource:0}: Error finding container 016f51783b7a921975d63225239e8d40db7b71e470a0bfead338ba66a3bc0776: Status 404 returned error can't find the container with id 016f51783b7a921975d63225239e8d40db7b71e470a0bfead338ba66a3bc0776
Nov 02 14:14:22.042057 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.042015    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6" event={"ID":"1574ed0f-3aea-4269-8338-ba112dcc402c","Type":"ContainerStarted","Data":"016f51783b7a921975d63225239e8d40db7b71e470a0bfead338ba66a3bc0776"}
Nov 02 14:14:22.046301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.044663    5453 generic.go:356] "Generic (PLEG): container finished" podID="7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" containerID="efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a" exitCode=0
Nov 02 14:14:22.046301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.044791    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk" event={"ID":"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580","Type":"ContainerDied","Data":"efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a"}
Nov 02 14:14:22.046301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.044841    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk" event={"ID":"7296d2ce-8bd6-4f53-a60c-41c2eb6a9580","Type":"ContainerDied","Data":"9aa7b0a741ae6324eced60061cc06d38333bafaeddc769e463f991cc6507c978"}
Nov 02 14:14:22.046301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.045242    5453 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"
Nov 02 14:14:22.046737 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.046685    5453 scope.go:122] "RemoveContainer" containerID="efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a"
Nov 02 14:14:22.060337 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.060279    5453 scope.go:122] "RemoveContainer" containerID="efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a"
Nov 02 14:14:22.060638 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:14:22.060616    5453 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a\": container with ID starting with efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a not found: ID does not exist" containerID="efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a"
Nov 02 14:14:22.060714 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.060652    5453 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a"} err="failed to get container status \"efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a\": rpc error: code = NotFound desc = could not find container \"efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a\": container with ID starting with efa6bc89ef43eb82d7dee27d2e8af5d8211c89508b24ee47652e5829f03d457a not found: ID does not exist"
Nov 02 14:14:22.082170 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.082137    5453 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"]
Nov 02 14:14:22.083478 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:22.083450    5453 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-h8bwk"]
Nov 02 14:14:23.042779 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:23.042745    5453 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" path="/var/lib/kubelet/pods/7296d2ce-8bd6-4f53-a60c-41c2eb6a9580/volumes"
Nov 02 14:14:23.052586 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:23.052553    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6" event={"ID":"1574ed0f-3aea-4269-8338-ba112dcc402c","Type":"ContainerStarted","Data":"20e09ea6e2813f6b862180f85268c13f0ee975234ab2665dc4c4876415088cd0"}
Nov 02 14:14:23.052796 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:23.052657    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:23.075582 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:23.075524    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6" podStartSLOduration=2.638172136 podStartE2EDuration="3.075507656s" totalImagesPullingTime="437.33552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:14:23.074027392 +0000 UTC m=+1842.155172515" watchObservedRunningTime="2026-11-02 14:14:23.075507656 +0000 UTC m=+1842.156652776"
Nov 02 14:14:23.543553 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:23.543507    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:23.728219 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:23.728184    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:24.773720 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:24.773688    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:25.004673 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:25.004635    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:25.859690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:25.859654    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:26.687642 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:26.687609    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:27.447090 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:27.447044    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:28.421363 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:28.421325    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:29.065685 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:29.065657    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-556bc67b74-tlwn6"
Nov 02 14:14:29.315921 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:29.315836    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:30.216582 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:30.216515    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:31.085640 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:31.085606    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:31.871711 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:31.871675    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:32.733816 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:32.733780    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:33.583326 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:33.583293    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:34.462248 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:34.462206    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:35.241627 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:35.241592    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:35.946379 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:35.946345    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:36.083640 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:14:36.083598    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:14:36.641198 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:36.641164    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:37.495536 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:37.495491    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:38.378465 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:38.378419    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:39.357426 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:39.357356    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:40.280537 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:40.280490    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:41.074967 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:41.074929    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:41.889977 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:41.889910    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:42.801444 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:42.801407    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:43.589229 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:43.589198    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:44.421113 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:44.421040    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:44.674477 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:44.674391    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:45.132589 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:45.132555    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:45.294033 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:45.293990    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:45.421551 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:45.421461    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:50.477432 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:50.477386    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:14:53.740528 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:14:53.740494    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:01.778411 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:01.778374    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:02.245673 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:02.245624    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:02.408955 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:02.408914    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:05.591457 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:05.591417    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:05.825085 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:05.825033    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:06.083167 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:15:06.083130    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:15:06.766487 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:06.766445    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:06.938730 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:06.938686    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:07.089424 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:07.089379    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:07.780735 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:07.780686    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:08.466371 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:08.466333    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:09.290359 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:09.290318    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:10.190386 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:10.190350    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:10.982117 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:10.982051    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:11.871207 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:11.871116    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:12.584352 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:12.584296    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:13.386353 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:13.386323    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:14.337947 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:14.337906    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:15.266825 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:15.266791    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:16.102223 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:16.102190    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:16.964953 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:16.964884    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:17.764447 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:17.764413    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:18.678243 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:18.678202    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:19.603279 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:19.603192    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:20.406401 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:20.406369    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:20.565793 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:20.565754    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:21.280112 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:21.280049    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:22.105653 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:22.105617    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:22.918892 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:22.918855    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:23.677910 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:23.677851    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:24.476937 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:24.476893    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:25.367831 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:25.367788    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:26.171081 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:26.171020    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:26.937125 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:26.937092    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:27.678222 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:27.678190    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:28.378131 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:28.378093    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:29.362236 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:29.362202    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:30.129020 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:30.128989    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:30.860977 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:30.860941    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:31.571814 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:31.571777    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:32.516769 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:32.516736    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:33.370919 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:33.370868    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:34.147387 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:34.147354    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:34.864373 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:34.864340    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:35.699661 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:35.699622    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:36.085161 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:15:36.085126    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:15:36.447184 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:36.447099    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:37.151730 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:37.151693    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:38.047287 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:38.047247    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:38.656743 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:38.656705    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:39.498380 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:39.498347    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:40.178805 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:40.178769    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:40.952511 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:40.952467    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:41.653493 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:41.653451    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:42.464948 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:42.464892    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:43.353850 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:43.353800    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:44.055698 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:44.055661    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:44.809985 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:44.809946    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:45.550162 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:45.550128    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:46.266586 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:46.266543    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:47.080187 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:47.080136    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:47.949061 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:47.949008    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:48.151943 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:48.151906    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:48.808355 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:48.808308    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:49.458047 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:49.458012    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:50.149261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:50.149224    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:50.857365 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:50.857328    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:51.558657 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:51.558618    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:52.254690 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:52.254655    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:52.951456 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:52.951415    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:53.719621 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:53.719586    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:53.864437 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:53.864399    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:54.460461 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:54.460433    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:55.165292 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:55.165254    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:55.944261 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:55.944224    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:56.654743 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:56.654708    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:57.411611 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:57.411563    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:58.218162 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:58.218127    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:59.036894 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:59.036856    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:15:59.771642 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:15:59.771587    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:00.562097 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:00.562039    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:01.520363 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:01.520328    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:02.163267 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:02.163234    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:02.899352 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:02.899315    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:03.664511 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:03.664441    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:04.356231 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:04.356195    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:05.045371 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:05.045338    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:05.862783 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:05.862736    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:06.083589 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:16:06.083554    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:16:06.659090 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:06.659049    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:07.361783 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:07.361733    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:08.058684 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:08.058644    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:08.777333 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:08.777297    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:09.474042 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:09.473999    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:10.160301 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:10.160268    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:10.941962 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:10.941902    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:11.748416 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:11.748376    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:12.453498 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:12.453455    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:13.260498 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:13.260459    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:13.957295 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:13.957252    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:14.665693 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:14.665653    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:15.434168 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:15.434131    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:16.163934 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:16.163899    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:16.858602 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:16.858553    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:17.557313 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:17.557274    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:18.258468 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:18.258428    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:19.276311 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:19.276280    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:20.275618 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:20.275581    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:20.963624 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:20.963586    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:21.757329 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:21.757295    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:22.470448 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:22.470411    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:23.246302 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:23.246266    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:23.948686 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:23.948653    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:24.654417 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:24.654381    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:25.369145 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:25.369015    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:26.064748 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:26.064703    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:26.747732 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:26.747696    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:27.456615 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:27.456567    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:28.251185 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:28.251150    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:28.970290 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:28.970256    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:29.705133 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:29.705092    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:30.378323 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:30.378281    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:31.192945 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:31.192906    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:31.873201 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:31.873162    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:32.646620 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:32.646584    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:33.472541 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:33.472502    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:34.159693 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:34.159657    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:34.850873 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:34.850836    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:35.551945 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:35.551910    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:36.084283 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:16:36.084252    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:16:36.259752 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:36.259714    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:36.969162 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:36.969128    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:37.791247 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:37.791190    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:38.460939 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:38.460891    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:39.184780 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:39.184740    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:39.960561 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:39.960529    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:40.768094 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:40.768026    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:41.597442 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:41.597403    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:42.600733 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:42.600695    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:43.357030 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:43.356992    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:44.155633 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:44.155592    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:44.882058 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:44.882018    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:45.645659 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:45.645624    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:46.355271 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:46.355235    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:47.152920 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:47.152878    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:48.003267 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:48.003231    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:48.782303 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:48.782266    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:49.537944 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:49.537894    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:50.375498 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:50.375465    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:51.390527 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:51.390492    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:52.270319 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:52.270287    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:52.965418 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:52.965387    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:53.656971 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:53.656936    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:53.844910 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:53.844872    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:54.367931 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:54.367900    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:55.058214 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:55.058179    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:55.748713 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:55.748678    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:56.558392 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:56.558354    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:57.445703 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:57.445646    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:58.177387 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:58.177351    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:58.877268 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:58.877235    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:16:59.819715 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:16:59.819669    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:00.574488 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:00.574440    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:00.772140 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:00.772112    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:00.905851 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:00.905760    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:06.083450 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:17:06.083398    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:17:06.268198 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:06.268145    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:06.420459 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:06.420367    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:06.548954 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:06.548909    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:06.980519 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:06.980483    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:08.804941 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:08.804903    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:13.232594 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:13.232554    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:13.377635 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:13.377599    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:13.606624 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:13.606575    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:17:36.084810 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:17:36.084769    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:17:54.027309 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:17:54.027258    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:18:02.965008 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:02.964964    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d779c7bfc-96jbk_9ba4e0ea-9138-4006-b98c-aae997efa6f4/authorino/0.log"
Nov 02 14:18:06.085647 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:18:06.085609    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:18:23.946164 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:23.946127    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-lckhh_e82d547c-4105-4576-ac9b-ffe39b1fe222/manager/0.log"
Nov 02 14:18:25.754314 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:25.754274    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-556bc67b74-tlwn6_1574ed0f-3aea-4269-8338-ba112dcc402c/maas-api/0.log"
Nov 02 14:18:28.504528 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:28.504494    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d779c7bfc-96jbk_9ba4e0ea-9138-4006-b98c-aae997efa6f4/authorino/0.log"
Nov 02 14:18:29.064667 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:29.064635    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-zkdfp_a47e1366-a355-4642-be3c-a138e9d0177f/kuadrant-console-plugin/0.log"
Nov 02 14:18:29.265502 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:29.265467    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-gd2fx_af0b4a8a-f5ce-4b88-ba59-e973c6163b50/manager/0.log"
Nov 02 14:18:29.661831 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:29.661788    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2kd2_931244c4-a71e-46c2-8ef9-ccab978d71b6/manager/0.log"
Nov 02 14:18:30.990313 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:30.990278    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb985f76c-l524w_c1c465e1-dd6c-4dc3-8951-1e81c9598e27/kube-auth-proxy/0.log"
Nov 02 14:18:31.156723 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:31.156690    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-bmx8h_f6c7276c-47b7-492f-8eb0-9c3d80797832/istio-proxy/0.log"
Nov 02 14:18:32.046285 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:32.046251    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-hw5qn_e8b648f5-c74b-456d-a0f5-8421e4afb536/istio-proxy/0.log"
Nov 02 14:18:32.212117 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:32.212089    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-jlgxm_d44a11c9-7eec-4447-8899-5df89d8c9923/istio-proxy/0.log"
Nov 02 14:18:33.633781 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:33.633730    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:18:33.763153 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:33.763111    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:18:36.087817 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:18:36.084749    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:18:40.566941 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:40.566906    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:18:40.715597 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:40.715558    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:18:41.433157 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:41.433116    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d779c7bfc-96jbk_9ba4e0ea-9138-4006-b98c-aae997efa6f4/authorino/0.log"
Nov 02 14:18:51.082917 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:51.082882    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-lckhh_e82d547c-4105-4576-ac9b-ffe39b1fe222/manager/0.log"
Nov 02 14:18:52.586408 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:52.586359    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-556bc67b74-tlwn6_1574ed0f-3aea-4269-8338-ba112dcc402c/maas-api/0.log"
Nov 02 14:18:53.963704 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:53.963662    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:18:54.585340 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:54.585293    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d779c7bfc-96jbk_9ba4e0ea-9138-4006-b98c-aae997efa6f4/authorino/0.log"
Nov 02 14:18:55.194669 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:55.194643    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-zkdfp_a47e1366-a355-4642-be3c-a138e9d0177f/kuadrant-console-plugin/0.log"
Nov 02 14:18:55.382578 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:55.382542    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-gd2fx_af0b4a8a-f5ce-4b88-ba59-e973c6163b50/manager/0.log"
Nov 02 14:18:55.786288 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:55.786249    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2kd2_931244c4-a71e-46c2-8ef9-ccab978d71b6/manager/0.log"
Nov 02 14:18:56.888104 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:56.888033    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb985f76c-l524w_c1c465e1-dd6c-4dc3-8951-1e81c9598e27/kube-auth-proxy/0.log"
Nov 02 14:18:57.065875 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:57.065846    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-bmx8h_f6c7276c-47b7-492f-8eb0-9c3d80797832/istio-proxy/0.log"
Nov 02 14:18:57.992792 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:57.992753    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-hw5qn_e8b648f5-c74b-456d-a0f5-8421e4afb536/istio-proxy/0.log"
Nov 02 14:18:58.155917 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:18:58.155872    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-jlgxm_d44a11c9-7eec-4447-8899-5df89d8c9923/istio-proxy/0.log"
Nov 02 14:19:06.085439 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:19:06.085400    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:19:15.382579 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:19:15.382542    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:19:36.084494 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:19:36.084457    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:19:54.018650 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:19:54.018550    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:19:54.152257 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:19:54.152223    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:20:06.083464 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:20:06.083420    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:20:36.089170 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:20:36.089126    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:20:54.064549 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:20:54.064513    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:20:54.198778 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:20:54.198736    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:21:00.336814 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:00.336774    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:21:00.487661 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:00.487599    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:21:06.083944 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:21:06.083907    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:21:12.757040 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:12.756992    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:21:12.906757 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:12.906715    5453 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log" limit=1024
Nov 02 14:21:15.830446 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:15.830407    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2lgfl_0aacf513-c851-4576-8689-d08f3c0c0ccb/global-pull-secret-syncer/0.log"
Nov 02 14:21:16.171260 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:16.171140    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h7znv_59195bdc-66bf-4fe0-80a2-5f3a55add215/konnectivity-agent/0.log"
Nov 02 14:21:16.416133 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:16.416055    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-166.us-east-2.compute.internal_8d5883c7dbe396f1be7fa323b910e645/haproxy/0.log"
Nov 02 14:21:23.051509 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:23.051418    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d779c7bfc-96jbk_9ba4e0ea-9138-4006-b98c-aae997efa6f4/authorino/0.log"
Nov 02 14:21:23.215732 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:23.215705    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-zkdfp_a47e1366-a355-4642-be3c-a138e9d0177f/kuadrant-console-plugin/0.log"
Nov 02 14:21:23.271264 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:23.271233    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-gd2fx_af0b4a8a-f5ce-4b88-ba59-e973c6163b50/manager/0.log"
Nov 02 14:21:23.360734 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:23.360622    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-d2kd2_931244c4-a71e-46c2-8ef9-ccab978d71b6/manager/0.log"
Nov 02 14:21:25.075051 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.075015    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-stvt7_b25c973e-ffda-4a4e-b993-a7b497f0101f/kube-state-metrics/0.log"
Nov 02 14:21:25.096220 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.096192    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-stvt7_b25c973e-ffda-4a4e-b993-a7b497f0101f/kube-rbac-proxy-main/0.log"
Nov 02 14:21:25.121974 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.121949    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-stvt7_b25c973e-ffda-4a4e-b993-a7b497f0101f/kube-rbac-proxy-self/0.log"
Nov 02 14:21:25.195214 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.195182    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-pr8zs_cc49235c-8639-439b-be7a-a34abd071d49/monitoring-plugin/0.log"
Nov 02 14:21:25.230331 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.230269    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vmlv_42958d29-5904-4838-a53c-09daea08f7ee/node-exporter/0.log"
Nov 02 14:21:25.255955 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.255923    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vmlv_42958d29-5904-4838-a53c-09daea08f7ee/kube-rbac-proxy/0.log"
Nov 02 14:21:25.285417 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.285386    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vmlv_42958d29-5904-4838-a53c-09daea08f7ee/init-textfile/0.log"
Nov 02 14:21:25.510863 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.510782    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-j8z7c_27d8613c-01dc-4cab-873e-543602bf77e8/kube-rbac-proxy-main/0.log"
Nov 02 14:21:25.536872 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.536842    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-j8z7c_27d8613c-01dc-4cab-873e-543602bf77e8/kube-rbac-proxy-self/0.log"
Nov 02 14:21:25.568416 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.568388    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-j8z7c_27d8613c-01dc-4cab-873e-543602bf77e8/openshift-state-metrics/0.log"
Nov 02 14:21:25.607626 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.607604    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e4bee65-de10-48f5-94d4-cb2738d379f4/prometheus/0.log"
Nov 02 14:21:25.633976 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.633951    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e4bee65-de10-48f5-94d4-cb2738d379f4/config-reloader/0.log"
Nov 02 14:21:25.670179 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.670143    5453 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"]
Nov 02 14:21:25.670561 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.670548    5453 cpu_manager.go:414] "containerMap: removing container" podUID="7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" containerName="maas-api"
Nov 02 14:21:25.670608 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.670564    5453 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" containerName="maas-api"
Nov 02 14:21:25.670704 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.670646    5453 memory_manager.go:365] "RemoveStaleState removing state" podUID="7296d2ce-8bd6-4f53-a60c-41c2eb6a9580" containerName="maas-api"
Nov 02 14:21:25.674402 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.674378    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.681958 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.681933    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g76p8\"/\"openshift-service-ca.crt\""
Nov 02 14:21:25.683347 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.683245    5453 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g76p8\"/\"kube-root-ca.crt\""
Nov 02 14:21:25.683347 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.683251    5453 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g76p8\"/\"default-dockercfg-f4qh7\""
Nov 02 14:21:25.685942 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.685918    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"]
Nov 02 14:21:25.691244 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.691220    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e4bee65-de10-48f5-94d4-cb2738d379f4/thanos-sidecar/0.log"
Nov 02 14:21:25.718636 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.718574    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e4bee65-de10-48f5-94d4-cb2738d379f4/kube-rbac-proxy-web/0.log"
Nov 02 14:21:25.750176 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.750147    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e4bee65-de10-48f5-94d4-cb2738d379f4/kube-rbac-proxy/0.log"
Nov 02 14:21:25.777173 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.777058    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e4bee65-de10-48f5-94d4-cb2738d379f4/kube-rbac-proxy-thanos/0.log"
Nov 02 14:21:25.788807 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.788768    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-proc\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.788963 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.788829    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-sys\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.788963 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.788890    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-lib-modules\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.789050 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.788977    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-podres\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.789050 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.789013    5453 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjsj\" (UniqueName: \"kubernetes.io/projected/40ebd592-027f-4873-90a3-e998b945a78b-kube-api-access-qwjsj\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.805439 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.805404    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3e4bee65-de10-48f5-94d4-cb2738d379f4/init-config-reloader/0.log"
Nov 02 14:21:25.889599 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889562    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-proc\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.889785 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889609    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-sys\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.889785 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889627    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-lib-modules\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.889785 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889662    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-podres\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.889785 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889689    5453 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjsj\" (UniqueName: \"kubernetes.io/projected/40ebd592-027f-4873-90a3-e998b945a78b-kube-api-access-qwjsj\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.889785 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889715    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-sys\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.889785 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889715    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-proc\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.889785 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889768    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-podres\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.890012 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.889801    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40ebd592-027f-4873-90a3-e998b945a78b-lib-modules\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.902397 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.902359    5453 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjsj\" (UniqueName: \"kubernetes.io/projected/40ebd592-027f-4873-90a3-e998b945a78b-kube-api-access-qwjsj\") pod \"perf-node-gather-daemonset-bpfbb\" (UID: \"40ebd592-027f-4873-90a3-e998b945a78b\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:25.989739 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:25.989700    5453 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:26.270054 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:26.270024    5453 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"]
Nov 02 14:21:26.272851 ip-10-0-131-166 kubenswrapper[5453]: W1102 14:21:26.272812    5453 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod40ebd592_027f_4873_90a3_e998b945a78b.slice/crio-fd0d3838022179cb6f558ac3ba97903ffc92c2cdc1220f5fee93ad466561d894 WatchSource:0}: Error finding container fd0d3838022179cb6f558ac3ba97903ffc92c2cdc1220f5fee93ad466561d894: Status 404 returned error can't find the container with id fd0d3838022179cb6f558ac3ba97903ffc92c2cdc1220f5fee93ad466561d894
Nov 02 14:21:26.338871 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:26.338836    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb" event={"ID":"40ebd592-027f-4873-90a3-e998b945a78b","Type":"ContainerStarted","Data":"fd0d3838022179cb6f558ac3ba97903ffc92c2cdc1220f5fee93ad466561d894"}
Nov 02 14:21:27.345514 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:27.345475    5453 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb" event={"ID":"40ebd592-027f-4873-90a3-e998b945a78b","Type":"ContainerStarted","Data":"2761b50f44195535bf4fa9590f1763ef6805ab0b044e821e111944bdf9621166"}
Nov 02 14:21:27.346055 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:27.345559    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:27.365203 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:27.365146    5453 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb" podStartSLOduration=2.365129581 podStartE2EDuration="2.365129581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 14:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:21:27.362762934 +0000 UTC m=+2266.443908055" watchObservedRunningTime="2026-11-02 14:21:27.365129581 +0000 UTC m=+2266.446274697"
Nov 02 14:21:30.641189 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:30.641144    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8qbcp_0002f62b-5055-4220-8db5-114709282274/dns/0.log"
Nov 02 14:21:30.668698 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:30.668668    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8qbcp_0002f62b-5055-4220-8db5-114709282274/kube-rbac-proxy/0.log"
Nov 02 14:21:30.859582 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:30.859550    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w8cmr_09da1ecb-8aa1-4c64-aaa6-af5b9d9d46ba/dns-node-resolver/0.log"
Nov 02 14:21:31.607937 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:31.607899    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q5f2p_11cbc0ac-084e-4ded-81bf-51bc0ebdf74c/node-ca/0.log"
Nov 02 14:21:33.363959 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:33.363930    5453 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-bpfbb"
Nov 02 14:21:34.617346 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:34.617310    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb985f76c-l524w_c1c465e1-dd6c-4dc3-8951-1e81c9598e27/kube-auth-proxy/0.log"
Nov 02 14:21:34.669658 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:34.669629    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-bmx8h_f6c7276c-47b7-492f-8eb0-9c3d80797832/istio-proxy/0.log"
Nov 02 14:21:34.913394 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:34.913315    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-hw5qn_e8b648f5-c74b-456d-a0f5-8421e4afb536/istio-proxy/0.log"
Nov 02 14:21:34.952061 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:34.952026    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-jlgxm_d44a11c9-7eec-4447-8899-5df89d8c9923/istio-proxy/0.log"
Nov 02 14:21:36.083614 ip-10-0-131-166 kubenswrapper[5453]: E1102 14:21:36.083573    5453 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k6nbb" containerName="extractor"
Nov 02 14:21:36.786164 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:36.786123    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gfpz8_b207bcfa-5e2e-4190-ac0b-82a05dca20ec/serve-healthcheck-canary/0.log"
Nov 02 14:21:37.800793 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:37.800751    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6nbb_e296d175-5e39-47c7-87fb-a11e6df8a494/kube-rbac-proxy/0.log"
Nov 02 14:21:37.829423 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:37.829395    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6nbb_e296d175-5e39-47c7-87fb-a11e6df8a494/exporter/0.log"
Nov 02 14:21:37.862338 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:37.862307    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k6nbb_e296d175-5e39-47c7-87fb-a11e6df8a494/extractor/0.log"
Nov 02 14:21:38.378216 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:38.378165    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb985f76c-l524w_c1c465e1-dd6c-4dc3-8951-1e81c9598e27/kube-auth-proxy/0.log"
Nov 02 14:21:38.400290 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:38.400260    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-bmx8h_f6c7276c-47b7-492f-8eb0-9c3d80797832/istio-proxy/0.log"
Nov 02 14:21:38.505702 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:38.505669    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-hw5qn_e8b648f5-c74b-456d-a0f5-8421e4afb536/istio-proxy/0.log"
Nov 02 14:21:38.524062 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:38.524027    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-jlgxm_d44a11c9-7eec-4447-8899-5df89d8c9923/istio-proxy/0.log"
Nov 02 14:21:40.797851 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:40.797787    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-c559bd947-mdzp4_e1b3610a-bd1b-47c9-a004-0bf415c82cf5/manager/0.log"
Nov 02 14:21:40.959986 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:40.959954    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-c559bd947-mdzp4_e1b3610a-bd1b-47c9-a004-0bf415c82cf5/copy-manifests/0.log"
Nov 02 14:21:42.316982 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:42.316945    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb985f76c-l524w_c1c465e1-dd6c-4dc3-8951-1e81c9598e27/kube-auth-proxy/0.log"
Nov 02 14:21:42.345151 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:42.345115    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-bmx8h_f6c7276c-47b7-492f-8eb0-9c3d80797832/istio-proxy/0.log"
Nov 02 14:21:42.462373 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:42.462344    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-hw5qn_e8b648f5-c74b-456d-a0f5-8421e4afb536/istio-proxy/0.log"
Nov 02 14:21:42.493534 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:42.493499    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-jlgxm_d44a11c9-7eec-4447-8899-5df89d8c9923/istio-proxy/0.log"
Nov 02 14:21:42.503816 ip-10-0-131-166 kubenswrapper[5453]: I1102 14:21:42.503788    5453 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-d7fv2_6cd425bc-cb94-462a-b310-05e9e1fa0c22/jobset-operator/0.log"