Nov 03 05:54:32.588841 ip-10-0-138-242 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 05:54:33.019228 ip-10-0-138-242 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 05:54:33.019228 ip-10-0-138-242 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 05:54:33.019228 ip-10-0-138-242 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 05:54:33.019228 ip-10-0-138-242 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 05:54:33.026292 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026212    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.026292 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026292    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026296    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026300    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026303    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026305    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026308    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026311    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026314    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026316    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026319    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026322    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026324    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026327    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026329    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026332    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026336    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026339    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026341    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026344    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026350    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.026362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026355    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026360    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026363    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026366    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026369    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026372    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026376    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026379    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026381    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026384    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026387    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026390    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026392    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026395    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026397    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026400    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026403    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026405    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026408    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.026830 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026410    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026413    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026415    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026419    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026421    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026424    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026427    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026429    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026432    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026434    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026437    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026440    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026442    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026445    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026447    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026451    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026454    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026456    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026459    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026463    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.027271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026465    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026468    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026470    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026473    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026476    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026478    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026481    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026484    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026486    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026489    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026491    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026494    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026496    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026512    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026515    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026518    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026521    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026523    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026526    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.027750 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026528    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026531    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026534    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026537    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026539    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026543    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026547    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026550    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026554    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026556    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026559    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026562    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026565    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026568    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026570    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026573    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026576    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026578    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026581    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026583    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.028192 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026586    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026589    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026591    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026594    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026596    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026599    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.026602    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027393    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027400    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027403    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027406    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027409    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027412    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027415    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027418    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027420    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027423    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027426    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027429    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.028678 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027433    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027439    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027442    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027445    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027448    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027450    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027453    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027456    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027459    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027462    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027464    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027467    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027469    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027479    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027482    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027485    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027488    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027491    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027494    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.029162 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027497    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027513    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027517    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027521    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027524    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027528    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027531    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027534    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027537    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027539    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027542    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027545    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027549    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027553    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027559    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027562    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027565    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027568    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027571    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027574    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.029629 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027577    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027579    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027583    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027585    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027588    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027590    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027593    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027596    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027599    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027601    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027604    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027606    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027609    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027611    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027614    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027617    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027619    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027622    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027625    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027628    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.030100 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027630    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027633    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027636    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027639    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027641    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027644    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027647    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027650    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027653    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027655    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027658    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027660    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027663    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027666    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027668    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027671    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027673    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027677    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027680    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027682    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.030580 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027685    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027688    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027690    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027693    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027695    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027698    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027700    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027703    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027705    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027708    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027710    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027713    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027716    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027719    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.027721    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028264    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028270    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028274    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028277    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.031042 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028280    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028283    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028285    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028289    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028291    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028294    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028297    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028300    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028302    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028305    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028308    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028311    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028313    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028316    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028318    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028321    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028324    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028326    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028329    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028332    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.031495 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028334    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028337    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028340    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028342    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028346    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028349    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028351    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028354    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028357    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028359    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028362    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028365    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028367    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028370    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028373    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028375    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028378    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028380    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028383    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028385    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.031965 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028388    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028390    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028395    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028398    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028401    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028403    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028406    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028409    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028411    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028414    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028417    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028420    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028422    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028425    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028428    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028431    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028433    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028436    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028439    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.032445 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028441    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028444    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028447    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028450    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028452    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028455    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028458    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028461    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028463    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028466    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028468    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028471    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028474    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028476    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028479    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028481    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028484    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028486    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028489    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028491    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.033565 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028494    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028496    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028514    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028519    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028523    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028528    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028531    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028534    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028536    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028539    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028541    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028544    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028549    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028553    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028556    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028559    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028562    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028565    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028567    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.034041 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028570    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028573    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028575    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.028578    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028667    2575 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028675    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028681    2575 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028687    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028692    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028695    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028700    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028704    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028707    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028710    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028714    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028717    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028720    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028723    2575 flags.go:64] FLAG: --cgroup-root=""
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028727    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028732    2575 flags.go:64] FLAG: --client-ca-file=""
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028735    2575 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028738    2575 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028742    2575 flags.go:64] FLAG: --cluster-domain=""
Nov 03 05:54:33.034521 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028745    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028748    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028752    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028755    2575 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028760    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028763    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028766    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028770    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028773    2575 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028776    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028779    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028782    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028785    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028789    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028792    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028795    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028798    2575 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028801    2575 flags.go:64] FLAG: --enable-server="true"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028804    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028809    2575 flags.go:64] FLAG: --event-burst="100"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028812    2575 flags.go:64] FLAG: --event-qps="50"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028815    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028819    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028822    2575 flags.go:64] FLAG: --eviction-hard=""
Nov 03 05:54:33.035052 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028826    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028829    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028833    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028837    2575 flags.go:64] FLAG: --eviction-soft=""
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028841    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028844    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028847    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028850    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028853    2575 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028856    2575 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028859    2575 flags.go:64] FLAG: --feature-gates=""
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028864    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028867    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028870    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028874    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028877    2575 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028880    2575 flags.go:64] FLAG: --help="false"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028883    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028886    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028889    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028892    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028896    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028899    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028902    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 05:54:33.035768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028905    2575 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028908    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028911    2575 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028915    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028918    2575 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028921    2575 flags.go:64] FLAG: --kube-reserved=""
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028924    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028926    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028929    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028932    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028935    2575 flags.go:64] FLAG: --lock-file=""
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028939    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028943    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028947    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028953    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028956    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028959    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028962    2575 flags.go:64] FLAG: --logging-format="text"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028965    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028969    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028974    2575 flags.go:64] FLAG: --manifest-url=""
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028977    2575 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028981    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028984    2575 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028988    2575 flags.go:64] FLAG: --max-pods="110"
Nov 03 05:54:33.036331 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028991    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028994    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.028998    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029000    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029003    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029007    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029010    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029016    2575 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029019    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029022    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029026    2575 flags.go:64] FLAG: --pod-cidr=""
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029028    2575 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029032    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029035    2575 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029038    2575 flags.go:64] FLAG: --port="10250"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029041    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029044    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dacf5a621e7b6716"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029047    2575 flags.go:64] FLAG: --qos-reserved=""
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029051    2575 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029056    2575 flags.go:64] FLAG: --register-node="true"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029059    2575 flags.go:64] FLAG: --register-with-taints=""
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029063    2575 flags.go:64] FLAG: --registry-burst="10"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029066    2575 flags.go:64] FLAG: --registry-qps="5"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029069    2575 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029072    2575 flags.go:64] FLAG: --reserved-memory=""
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029075    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 05:54:33.036930 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029079    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029082    2575 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029085    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029088    2575 flags.go:64] FLAG: --runonce="false"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029091    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029095    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029098    2575 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029100    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029103    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029106    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029110    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029113    2575 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029115    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029118    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029121    2575 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029124    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029127    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029130    2575 flags.go:64] FLAG: --system-cgroups=""
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029133    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029139    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029142    2575 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029145    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029149    2575 flags.go:64] FLAG: --tls-min-version=""
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029152    2575 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029156    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 05:54:33.037547 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029160    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029164    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029167    2575 flags.go:64] FLAG: --v="2"
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029171    2575 flags.go:64] FLAG: --version="false"
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029176    2575 flags.go:64] FLAG: --vmodule=""
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029180    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029183    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029319    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029323    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029326    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029331    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029334    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029337    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029340    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029343    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029346    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029349    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029352    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029355    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029358    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029360    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.038155 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029363    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029366    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029368    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029372    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029375    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029378    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029381    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029384    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029386    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029389    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029394    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029398    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029400    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029403    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029406    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029408    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029411    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029413    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029416    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.038658 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029419    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029422    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029424    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029427    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029430    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029433    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029435    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029438    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029441    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029443    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029446    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029449    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029451    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029454    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029457    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029459    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029462    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029464    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029467    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.039101 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029470    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029472    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029475    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029477    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029481    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029485    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029487    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029490    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029493    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029495    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029510    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029513    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029516    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029519    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029522    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029524    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029527    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029530    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029533    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029536    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.039926 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029539    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029541    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029544    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029546    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029549    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029552    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029554    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029558    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029562    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029565    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029568    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029571    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029573    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029575    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029578    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029581    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029585    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029588    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029591    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.040665 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029593    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029596    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029599    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029602    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029604    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029607    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029610    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029612    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029615    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029618    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029620    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029623    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029626    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029629    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029632    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.029658    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 05:54:33.041147 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029697    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029702    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029705    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029707    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029710    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029712    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029715    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029718    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029720    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029723    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029725    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029728    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029730    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029734    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029736    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029739    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029742    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029745    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029747    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029750    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.041549 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029752    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029755    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029758    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029760    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029763    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029765    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029768    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029770    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029774    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029776    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029780    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029784    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029787    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029790    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029793    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029795    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029798    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029800    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029803    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.042009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029805    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029808    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029810    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029813    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029815    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029818    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029821    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029823    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029826    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029829    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029831    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029834    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029836    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029839    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029841    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029844    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029847    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029849    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029852    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029855    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.042467 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029857    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029860    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029863    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029865    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029868    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029871    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029873    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029876    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029878    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029882    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029885    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029888    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029890    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029893    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029895    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029899    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029902    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029905    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029908    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.042960 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029911    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029914    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029916    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029919    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029922    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029924    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029927    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029929    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029932    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029934    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029937    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029939    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029942    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029945    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029947    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029950    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029953    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029956    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029958    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029961    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.043399 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029963    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029966    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029969    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029971    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029974    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029976    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029980    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.029982    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.037896    2575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.037912    2575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.038895    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.038902    2575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.038980    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.038986    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.038990    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.038993    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.038995    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.038998    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039001    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.043922 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039004    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039007    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039011    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039015    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039020    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039024    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039027    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039030    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039033    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039036    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039039    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039042    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039045    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039047    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039050    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039053    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039056    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039058    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039061    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039064    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.044357 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039067    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039069    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039123    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039266    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039274    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039278    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039285    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039288    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039292    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039295    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039298    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039303    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039306    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039309    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039313    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039316    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039324    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039327    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039332    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.044942 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039335    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039338    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039342    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039346    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039351    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039357    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039363    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039367    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039371    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039376    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039383    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039386    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039389    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039395    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039400    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039408    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039465    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039484    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.045376 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039489    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039495    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039511    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039526    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039537    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039542    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039546    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039550    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039555    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039560    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039565    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039569    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039573    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039577    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039582    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039586    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039596    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039601    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039605    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039609    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.045809 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039614    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039619    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039623    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039628    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039633    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039637    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039641    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039645    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039650    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039661    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039666    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039698    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039716    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039720    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039724    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039728    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039733    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039737    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039741    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039746    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.046263 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039750    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.039760    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.039833    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040879    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040892    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040896    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040901    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040905    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040910    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040914    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040918    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040922    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040926    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040931    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040935    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040939    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.046728 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040943    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040947    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040951    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040956    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040960    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040967    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040974    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040980    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040985    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040989    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040994    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.040998    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041001    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041006    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041010    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041014    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041019    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041023    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041027    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.047104 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041032    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041036    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041040    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041045    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041050    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041054    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041059    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041063    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041067    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041071    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041076    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041080    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041084    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041087    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041089    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041092    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041095    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041098    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041101    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041104    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.047604 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041106    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041109    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041112    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041114    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041117    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041120    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041122    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041125    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041128    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041131    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041158    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041164    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041168    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041170    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041173    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041176    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041179    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041183    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041187    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.048066 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041192    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041195    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041198    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041200    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041203    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041205    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041208    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041211    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041213    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041216    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041218    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041221    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041224    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041227    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041229    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041232    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041234    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041237    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041240    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041243    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.048517 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041245    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041248    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041250    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041253    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041256    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041258    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041261    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041263    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041266    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041269    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041272    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041274    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041277    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041281    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041284    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.041317    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 05:54:33.048995 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041366    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041371    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041374    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041377    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041379    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041382    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041385    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041388    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041390    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041393    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041395    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041399    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041402    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041404    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041407    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041409    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041412    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041415    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041418    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:54:33.049362 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041420    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041423    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041425    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041428    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041431    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041433    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041436    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041439    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041442    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041445    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041448    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041452    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041457    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041461    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041464    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041467    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041470    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041473    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041476    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:54:33.049821 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041479    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041481    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041484    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041487    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041490    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041492    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041495    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041512    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041518    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041521    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041524    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041526    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041529    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041532    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041534    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041537    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041540    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041542    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041545    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:54:33.050271 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041548    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041550    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041553    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041556    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041559    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041562    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041566    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041568    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041571    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041575    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041578    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041580    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041583    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041586    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041588    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041591    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041594    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041596    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041599    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041602    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:54:33.050764 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041604    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041607    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041610    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041613    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041616    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041620    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041626    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041629    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041632    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041634    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041637    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041640    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041642    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041645    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041648    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041651    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041653    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041656    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041659    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:54:33.051333 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041663    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041666    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041669    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041672    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041674    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041677    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041680    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041682    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041685    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:33.041687    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.041738    2575 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.044140    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.045179    2575 server.go:1014] "Starting client certificate rotation"
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.045278    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.045309    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.047538    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 05:54:33.051882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.051786    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 05:54:33.063738 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.063719    2575 log.go:25] "Validated CRI v1 runtime API"
Nov 03 05:54:33.067659 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.067645    2575 log.go:25] "Validated CRI v1 image API"
Nov 03 05:54:33.068524 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.068487    2575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 05:54:33.072947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.072923    2575 fs.go:135] Filesystem UUIDs: map[3e74a532-a85b-4bb9-9aba-47cc0c619769:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f4cefb93-28b7-45bd-80d4-41371bce98a2:/dev/nvme0n1p3]
Nov 03 05:54:33.072999 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.072947    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 03 05:54:33.078860 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.078747    2575 manager.go:217] Machine: {Timestamp:2026-11-03 05:54:33.077296359 +0000 UTC m=+0.378225704 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098926 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2322f0ec1d6646c3bbc870d804ced3 SystemUUID:ec2322f0-ec1d-6646-c3bb-c870d804ced3 BootID:15c0db89-ca27-4449-80b0-5825a48a3188 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e0:ec:7c:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e0:ec:7c:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:48:81:3a:3b:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 05:54:33.079456 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.079447    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 05:54:33.079569 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.079553    2575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 05:54:33.082967 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.082943    2575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 05:54:33.084308 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.082969    2575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 05:54:33.084308 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.083684    2575 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 05:54:33.084308 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.083719    2575 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 05:54:33.084308 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.083740    2575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 05:54:33.084308 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.083750    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 05:54:33.085194 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.085178    2575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 05:54:33.089764 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.089751    2575 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 05:54:33.089872 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.089864    2575 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 05:54:33.090669 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.090659    2575 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 05:54:33.090701 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.090676    2575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 05:54:33.090701 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.090688    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 05:54:33.090701 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.090697    2575 kubelet.go:405] "Adding apiserver pod source"
Nov 03 05:54:33.090772 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.090705    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 05:54:33.091018 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.091005    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 05:54:33.093364 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.093346    2575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 05:54:33.100252 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.100240    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 05:54:33.101200 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101188    2575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 05:54:33.101236 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101218    2575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 05:54:33.101370 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101360    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 05:54:33.101417 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101376    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 05:54:33.101417 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101382    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 05:54:33.101417 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101387    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 05:54:33.101417 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101393    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 05:54:33.101417 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.101399    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 05:54:33.102208 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.102199    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 05:54:33.102240 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.102209    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 05:54:33.102240 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.102216    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 05:54:33.102240 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.102223    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 05:54:33.102240 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.102232    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 05:54:33.102240 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.102240    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 05:54:33.103083 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.103074    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 05:54:33.103115 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.103084    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 05:54:33.106871 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.106857    2575 server.go:1263] "Started kubelet"
Nov 03 05:54:33.107000 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.106969    2575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 05:54:33.107064 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.106956    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 05:54:33.107064 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.107042    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 05:54:33.107759 ip-10-0-138-242 systemd[1]: Started Kubernetes Kubelet.
Nov 03 05:54:33.108472 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.108446    2575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 05:54:33.110299 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.109491    2575 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 05:54:33.114146 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.114126    2575 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 03 05:54:33.117472 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.117455    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 05:54:33.118071 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.118059    2575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 05:54:33.118203 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.118177    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.118789 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.118774    2575 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 05:54:33.118789 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.118791    2575 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 05:54:33.118925 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.118773    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 05:54:33.118925 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.118913    2575 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 05:54:33.118925 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.118919    2575 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 05:54:33.121180 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.121161    2575 factory.go:55] Registering systemd factory
Nov 03 05:54:33.121180 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.121181    2575 factory.go:223] Registration of the systemd container factory successfully
Nov 03 05:54:33.121573 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.121561    2575 factory.go:153] Registering CRI-O factory
Nov 03 05:54:33.121642 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.121578    2575 factory.go:223] Registration of the crio container factory successfully
Nov 03 05:54:33.121642 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.121634    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 05:54:33.121709 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.121656    2575 factory.go:103] Registering Raw factory
Nov 03 05:54:33.121709 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.121670    2575 manager.go:1199] Started watching for new ooms in manager
Nov 03 05:54:33.122763 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.122749    2575 manager.go:319] Starting recovery of all containers
Nov 03 05:54:33.134690 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.134672    2575 manager.go:324] Recovery completed
Nov 03 05:54:33.136489 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.135965    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Nov 03 05:54:33.139548 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.139531    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:54:33.140200 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.140156    2575 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 03 05:54:33.140200 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.140163    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 03 05:54:33.141227 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.141198    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:54:33.141283 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.141245    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:54:33.141283 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.141259    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:54:33.141349 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.140157    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-242.ec2.internal.18e47340a661d289  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-242.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-242.ec2.internal,},FirstTimestamp:2026-11-03 05:54:33.106829961 +0000 UTC m=+0.407759306,LastTimestamp:2026-11-03 05:54:33.106829961 +0000 UTC m=+0.407759306,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-242.ec2.internal,}"
Nov 03 05:54:33.141820 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.141808    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:54:33.141902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.141806    2575 cpu_manager.go:226] "Starting" policy="none"
Nov 03 05:54:33.141902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.141840    2575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 05:54:33.141902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.141878    2575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 05:54:33.142079 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.142034    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 05:54:33.142132 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.142086    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znhrw"
Nov 03 05:54:33.142603 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.142495    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:54:33.142686 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.142619    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:54:33.142686 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.142634    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:54:33.144151 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.144137    2575 policy_none.go:50] "Start"
Nov 03 05:54:33.144193 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.144155    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 05:54:33.144193 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.144174    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 05:54:33.146204 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.146192    2575 policy_none.go:44] "Start"
Nov 03 05:54:33.147319 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.147304    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znhrw"
Nov 03 05:54:33.153688 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.153669    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 03 05:54:33.153827 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.153810    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 03 05:54:33.153981 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.153962    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.173748    2575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.176993    2575 manager.go:341] "Starting Device Plugin manager"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.177022    2575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.177032    2575 server.go:87] "Starting device plugin registration server"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.177247    2575 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.177258    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.177353    2575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.177428    2575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.177436    2575 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.177957    2575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.178004    2575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.189629    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.190808    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.192232    2575 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.192256    2575 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 05:54:33.198042 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.192296    2575 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 03 05:54:33.207712 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.207694    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:54:33.277686 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.277632    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:54:33.279467 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.279448    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:54:33.279581 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.279490    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:54:33.279581 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.279520    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:54:33.279581 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.279551    2575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.293017 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.293000    2575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"]
Nov 03 05:54:33.293093 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.293052    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:54:33.293817 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.293805    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:54:33.293860 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.293829    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:54:33.293860 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.293838    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:54:33.296063 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296051    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:54:33.296206 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296193    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.296242 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296222    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:54:33.296779 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296757    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:54:33.296853 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296787    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:54:33.296853 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296797    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:54:33.296853 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296763    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:54:33.296941 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296866    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:54:33.296941 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.296879    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:54:33.297929 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.297914    2575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.297988 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.297934    2575 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-242.ec2.internal\": node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.298865 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.298851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.298908 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.298876    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:54:33.299631 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.299617    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:54:33.299700 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.299647    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:54:33.299700 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.299660    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:54:33.320235 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.320215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.320319 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.320239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.320319 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.320262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64792e0a2fa5247cd6cb1dcb331e5e11-config\") pod \"kube-apiserver-proxy-ip-10-0-138-242.ec2.internal\" (UID: \"64792e0a2fa5247cd6cb1dcb331e5e11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.328215 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.328198    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-242.ec2.internal\" not found" node="ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.330661 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.330645    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-242.ec2.internal\" not found" node="ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.338664 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.338644    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.420905 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.420878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.420905 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.420903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64792e0a2fa5247cd6cb1dcb331e5e11-config\") pod \"kube-apiserver-proxy-ip-10-0-138-242.ec2.internal\" (UID: \"64792e0a2fa5247cd6cb1dcb331e5e11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.421072 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.420920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.421072 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.420945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.421072 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.420964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.421072 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.420982    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64792e0a2fa5247cd6cb1dcb331e5e11-config\") pod \"kube-apiserver-proxy-ip-10-0-138-242.ec2.internal\" (UID: \"64792e0a2fa5247cd6cb1dcb331e5e11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.439097 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.439077    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.540035 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.539962    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.632865 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.632821    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.635986 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:33.635964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:33.641060 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.641044    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.741946 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.741920    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.842428 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.842366    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:33.942833 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:33.942812    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:34.043113 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:34.043089    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:34.045344 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.045321    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 03 05:54:34.045514 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.045477    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 03 05:54:34.121009 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:34.120983    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64792e0a2fa5247cd6cb1dcb331e5e11.slice/crio-7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e WatchSource:0}: Error finding container 7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e: Status 404 returned error can't find the container with id 7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e
Nov 03 05:54:34.121320 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:34.121309    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cadd07d0bc5cca312fe70e95ea81342.slice/crio-2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0 WatchSource:0}: Error finding container 2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0: Status 404 returned error can't find the container with id 2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0
Nov 03 05:54:34.127372 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.127352    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 05:54:34.143804 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:34.143783    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:34.154341 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.154315    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 05:49:32 +0000 UTC" deadline="2028-04-09 11:07:07.555976011 +0000 UTC"
Nov 03 05:54:34.154341 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.154336    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12557h12m33.401642027s"
Nov 03 05:54:34.195755 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.195720    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal" event={"ID":"64792e0a2fa5247cd6cb1dcb331e5e11","Type":"ContainerStarted","Data":"7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e"}
Nov 03 05:54:34.196623 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.196603    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal" event={"ID":"3cadd07d0bc5cca312fe70e95ea81342","Type":"ContainerStarted","Data":"2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0"}
Nov 03 05:54:34.230327 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.230310    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:54:34.244381 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:34.244354    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:34.344874 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:34.344855    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:34.445276 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:34.445220    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:54:34.509010 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.508953    2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:54:34.519008 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.518978    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:34.552330 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.552308    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 05:54:34.554346 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.554323    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:54:34.578899 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.578878    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 05:54:34.792364 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:34.792298    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:54:35.023251 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.023221    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:54:35.092712 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.092645    2575 apiserver.go:52] "Watching apiserver"
Nov 03 05:54:35.118425 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.118394    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 03 05:54:35.121898 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.121869    2575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 05:54:35.122242 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.122216    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98","openshift-multus/multus-tfmns","openshift-network-diagnostics/network-check-target-8669x","openshift-network-operator/iptables-alerter-2h7wj","openshift-cluster-node-tuning-operator/tuned-zgzqf","openshift-ovn-kubernetes/ovnkube-node-gk8rt","kube-system/global-pull-secret-syncer-t477r","kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal","openshift-multus/multus-additional-cni-plugins-7fb9t","kube-system/konnectivity-agent-hcd9r","openshift-dns/node-resolver-hjb7w","openshift-image-registry/node-ca-zn76c","openshift-multus/network-metrics-daemon-42ps6"]
Nov 03 05:54:35.124789 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.124768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.126757 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.126739    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.128679 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.128660    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:35.128756 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.128737    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:35.130682 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.130663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.133050 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.133033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.133137 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.133098    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:35.135410 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.135390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.138288 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.137913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.140189 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.140169    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 05:54:35.140275 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.140255    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z796t\""
Nov 03 05:54:35.143637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.143616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.144669 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.144650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.144754 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.144708    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 05:54:35.146270 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.146251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.146531 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.146487    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 05:54:35.146651 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.146638    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 05:54:35.147254 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.147153    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 05:54:35.147254 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.147197    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 05:54:35.147394 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.147279    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-krwzb\""
Nov 03 05:54:35.147394 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.147343    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 05:54:35.147486 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.147435    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-zq86f\""
Nov 03 05:54:35.147486 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.147478    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 05:54:35.147598 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.147585    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 05:54:35.149000 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.148787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.151200 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.151185    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:35.151273 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.151229    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:35.166053 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.166024    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 05:54:35.166137 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.166110    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6brqn"
Nov 03 05:54:35.173929 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.173909    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6brqn"
Nov 03 05:54:35.220145 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.220124    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 05:54:35.228449 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovn-node-metrics-cert\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.228608 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-tmp-dir\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.228608 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-cnibin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.228608 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-etc-kubernetes\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.228608 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c654a48-02bf-4015-85e1-be3bf1ef9b12-iptables-alerter-script\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.228730 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:35.228730 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-slash\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.228730 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.228730 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-config\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.228730 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-conf-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.228891 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.228891 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-host\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.228891 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-sys\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.228891 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a25e9f30-3ae1-4319-a77a-708295d60f0f-konnectivity-ca\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.228891 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-kubelet-config\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.228891 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-systemd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-system-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-cnibin\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228946    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-kubernetes\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.228983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/180ebbd8-f149-4418-b609-572389c6d617-serviceca\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t58q\" (UniqueName: \"kubernetes.io/projected/180ebbd8-f149-4418-b609-572389c6d617-kube-api-access-2t58q\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229023    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-dbus\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.229044 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smfrs\" (UniqueName: \"kubernetes.io/projected/4c654a48-02bf-4015-85e1-be3bf1ef9b12-kube-api-access-smfrs\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f45ll\" (UniqueName: \"kubernetes.io/projected/1d206e49-6bf6-4139-8e0f-02e7840cec50-kube-api-access-f45ll\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-ovn\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229107    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-env-overrides\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-script-lib\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-bin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c654a48-02bf-4015-85e1-be3bf1ef9b12-host-slash\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-systemd\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229246 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-netns\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-etc-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-bin\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-device-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-daemon-config\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-modprobe-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229479    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-netd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-socket-dir-parent\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-netns\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-multus-certs\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.229621 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-run\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-tmp\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-systemd-units\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwczz\" (UniqueName: \"kubernetes.io/projected/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-kube-api-access-vwczz\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlr7x\" (UniqueName: \"kubernetes.io/projected/c6083fc7-5b1c-42f1-831e-9a95857c0720-kube-api-access-xlr7x\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfmrr\" (UniqueName: \"kubernetes.io/projected/e4e3fb98-d6df-4769-8ee4-53219b93176e-kube-api-access-zfmrr\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-tuned\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-var-lib-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-node-log\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-log-socket\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s44kq\" (UniqueName: \"kubernetes.io/projected/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-kube-api-access-s44kq\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-socket-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-lib-modules\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-var-lib-kubelet\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp6km\" (UniqueName: \"kubernetes.io/projected/759c2efb-9378-426a-9f2b-2ee9179c84ca-kube-api-access-pp6km\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.229947 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-registration-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.229994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysconfig\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-sys-fs\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a25e9f30-3ae1-4319-a77a-708295d60f0f-agent-certs\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-multus\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-hostroot\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-system-cni-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-conf\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwf6w\" (UniqueName: \"kubernetes.io/projected/fc6f8642-bdd0-42b6-a018-98a1642752cc-kube-api-access-rwf6w\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-k8s-cni-cncf-io\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-kubelet\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.230468 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-hosts-file\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.231225 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-kubelet\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.231225 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180ebbd8-f149-4418-b609-572389c6d617-host\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.231225 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.230365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-cni-binary-copy\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.233613 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233594    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 05:54:35.233695 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233640    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 05:54:35.233747 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233711    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 05:54:35.233835 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233821    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 05:54:35.233907 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233881    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 05:54:35.233907 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233885    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 05:54:35.234007 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233934    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 05:54:35.234007 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233952    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 05:54:35.234007 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233989    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 05:54:35.234007 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.233989    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 05:54:35.234152 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234008    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 05:54:35.234152 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234103    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 05:54:35.234152 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234106    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 05:54:35.234152 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234144    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-75slc\""
Nov 03 05:54:35.234294 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234150    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 05:54:35.234294 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234155    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nphqj\""
Nov 03 05:54:35.234294 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234145    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 05:54:35.234294 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234220    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 05:54:35.234438 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234345    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 05:54:35.234438 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234355    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gfnmx\""
Nov 03 05:54:35.234438 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234359    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8hrbq\""
Nov 03 05:54:35.234438 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234372    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nvbtr\""
Nov 03 05:54:35.234438 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234373    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fkxng\""
Nov 03 05:54:35.234598 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.234447    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 05:54:35.331393 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331526 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwf6w\" (UniqueName: \"kubernetes.io/projected/fc6f8642-bdd0-42b6-a018-98a1642752cc-kube-api-access-rwf6w\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.331526 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-k8s-cni-cncf-io\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.331526 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-kubelet\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331526 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.331526 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-hosts-file\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-kubelet\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180ebbd8-f149-4418-b609-572389c6d617-host\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-cni-binary-copy\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovn-node-metrics-cert\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-tmp-dir\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-cnibin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-etc-kubernetes\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331671    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c654a48-02bf-4015-85e1-be3bf1ef9b12-iptables-alerter-script\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.331683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-slash\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-config\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-conf-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-host\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-sys\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a25e9f30-3ae1-4319-a77a-708295d60f0f-konnectivity-ca\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-kubelet-config\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-systemd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-system-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-cnibin\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-kubernetes\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/180ebbd8-f149-4418-b609-572389c6d617-serviceca\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.331902 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t58q\" (UniqueName: \"kubernetes.io/projected/180ebbd8-f149-4418-b609-572389c6d617-kube-api-access-2t58q\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-dbus\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331932    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smfrs\" (UniqueName: \"kubernetes.io/projected/4c654a48-02bf-4015-85e1-be3bf1ef9b12-kube-api-access-smfrs\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f45ll\" (UniqueName: \"kubernetes.io/projected/1d206e49-6bf6-4139-8e0f-02e7840cec50-kube-api-access-f45ll\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-ovn\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.331991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-env-overrides\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-script-lib\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-bin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c654a48-02bf-4015-85e1-be3bf1ef9b12-host-slash\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-systemd\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-host\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332231    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-hosts-file\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332280    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-dbus\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332310    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-kubelet\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332341    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-sys\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.332399 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332353    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180ebbd8-f149-4418-b609-572389c6d617-host\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332435    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-etc-kubernetes\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332615    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-tmp-dir\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-netns\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-etc-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332713    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-slash\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-bin\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-device-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-daemon-config\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332761    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-modprobe-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-netd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332804    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-k8s-cni-cncf-io\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-socket-dir-parent\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-netns\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.332942 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-multus-certs\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332862    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-run\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332872    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-netns\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-tmp\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-systemd-units\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332912    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-system-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwczz\" (UniqueName: \"kubernetes.io/projected/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-kube-api-access-vwczz\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlr7x\" (UniqueName: \"kubernetes.io/projected/c6083fc7-5b1c-42f1-831e-9a95857c0720-kube-api-access-xlr7x\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfmrr\" (UniqueName: \"kubernetes.io/projected/e4e3fb98-d6df-4769-8ee4-53219b93176e-kube-api-access-zfmrr\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-kubelet-config\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-tuned\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-var-lib-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-node-log\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333072    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-systemd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333082    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-kubernetes\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333111    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.333687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333149    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-var-lib-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333154    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-node-log\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333201    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-cnibin\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333201    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-log-socket\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333288    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-netns\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333302    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-cnibin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333327    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333324    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-log-socket\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333327    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-device-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s44kq\" (UniqueName: \"kubernetes.io/projected/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-kube-api-access-s44kq\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334401 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.332708    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-conf-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.334740 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334722    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/180ebbd8-f149-4418-b609-572389c6d617-serviceca\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.334768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333385    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-socket-dir-parent\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.334768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333435    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-systemd-units\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333646    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a25e9f30-3ae1-4319-a77a-708295d60f0f-konnectivity-ca\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.334768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333425    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-etc-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333669    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-run\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.334768 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-socket-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333709    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-multus-certs\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333794    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-daemon-config\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333800    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-socket-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.333865    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.334835    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret podName:44da4b70-4f4c-4cdf-8be7-684f68743c76 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:35.834822308 +0000 UTC m=+3.135751641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret") pod "global-pull-secret-syncer-t477r" (UID: "44da4b70-4f4c-4cdf-8be7-684f68743c76") : object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333936    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-modprobe-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333956    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334849    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-lib-modules\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333928    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-config\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333976    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-bin\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334025    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-ovn\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334085    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-netd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333996    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-bin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334096    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334113    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c654a48-02bf-4015-85e1-be3bf1ef9b12-host-slash\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334157    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-systemd\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.334957 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334385    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-env-overrides\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334410    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-script-lib\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334461    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-cni-binary-copy\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334698    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333676    2575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-lib-modules\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-var-lib-kubelet\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp6km\" (UniqueName: \"kubernetes.io/projected/759c2efb-9378-426a-9f2b-2ee9179c84ca-kube-api-access-pp6km\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.334137    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-kubelet\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.333954    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c654a48-02bf-4015-85e1-be3bf1ef9b12-iptables-alerter-script\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-registration-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335162    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysconfig\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-sys-fs\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a25e9f30-3ae1-4319-a77a-708295d60f0f-agent-certs\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.335637 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335232    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-registration-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-multus\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-hostroot\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-system-cni-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-conf\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335477    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-conf\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335600    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335652    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysconfig\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335677    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-sys-fs\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335714    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-hostroot\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335736    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-multus\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-system-cni-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.335800    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335816    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.335843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:54:35.835828613 +0000 UTC m=+3.136757957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.335870    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.336244 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.336005    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-var-lib-kubelet\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.338569 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.338544    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovn-node-metrics-cert\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.338668 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.338638    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a25e9f30-3ae1-4319-a77a-708295d60f0f-agent-certs\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.339105 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.339084    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-tuned\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.339177 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.339105    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-tmp\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.359876 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.359831    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 05:54:35.359876 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.359854    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 05:54:35.359876 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.359866    2575 projected.go:196] Error preparing data for projected volume kube-api-access-ccthw for pod openshift-network-diagnostics/network-check-target-8669x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:35.360030 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.359921    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw podName:b679ae94-3889-42b9-92f5-41793768bd69 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:35.85990584 +0000 UTC m=+3.160835188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ccthw" (UniqueName: "kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw") pod "network-check-target-8669x" (UID: "b679ae94-3889-42b9-92f5-41793768bd69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:35.362570 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.362549    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t58q\" (UniqueName: \"kubernetes.io/projected/180ebbd8-f149-4418-b609-572389c6d617-kube-api-access-2t58q\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.365823 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.365784    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s44kq\" (UniqueName: \"kubernetes.io/projected/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-kube-api-access-s44kq\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.365913 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.365889    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smfrs\" (UniqueName: \"kubernetes.io/projected/4c654a48-02bf-4015-85e1-be3bf1ef9b12-kube-api-access-smfrs\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.368045 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.368027    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfmrr\" (UniqueName: \"kubernetes.io/projected/e4e3fb98-d6df-4769-8ee4-53219b93176e-kube-api-access-zfmrr\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:35.368138 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.368065    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f45ll\" (UniqueName: \"kubernetes.io/projected/1d206e49-6bf6-4139-8e0f-02e7840cec50-kube-api-access-f45ll\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.368138 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.368088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp6km\" (UniqueName: \"kubernetes.io/projected/759c2efb-9378-426a-9f2b-2ee9179c84ca-kube-api-access-pp6km\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.368138 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.368087    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlr7x\" (UniqueName: \"kubernetes.io/projected/c6083fc7-5b1c-42f1-831e-9a95857c0720-kube-api-access-xlr7x\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.369378 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.369215    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwczz\" (UniqueName: \"kubernetes.io/projected/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-kube-api-access-vwczz\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.369675 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.369653    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwf6w\" (UniqueName: \"kubernetes.io/projected/fc6f8642-bdd0-42b6-a018-98a1642752cc-kube-api-access-rwf6w\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.437936 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.437915    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:54:35.444964 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:35.444946    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d206e49_6bf6_4139_8e0f_02e7840cec50.slice/crio-385a4736e5fdf0c2293938f0ad8ddb4fb39784fbfc5440433174e0040f3c2ea5 WatchSource:0}: Error finding container 385a4736e5fdf0c2293938f0ad8ddb4fb39784fbfc5440433174e0040f3c2ea5: Status 404 returned error can't find the container with id 385a4736e5fdf0c2293938f0ad8ddb4fb39784fbfc5440433174e0040f3c2ea5
Nov 03 05:54:35.449080 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.449063    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tfmns"
Nov 03 05:54:35.456013 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.455997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:54:35.485742 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.482864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:35.485742 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.485601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:54:35.491778 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.491758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:35.493001 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.492973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:54:35.495283 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:35.495257    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801a6f81_0e55_40e6_8740_2ab8bcf0cad8.slice/crio-5bc345cc8bfa45c624c845f8fcc953f9a35ee01cdb8c2e616de2d7da5dbf21c0 WatchSource:0}: Error finding container 5bc345cc8bfa45c624c845f8fcc953f9a35ee01cdb8c2e616de2d7da5dbf21c0: Status 404 returned error can't find the container with id 5bc345cc8bfa45c624c845f8fcc953f9a35ee01cdb8c2e616de2d7da5dbf21c0
Nov 03 05:54:35.497531 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:35.497435    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6f8642_bdd0_42b6_a018_98a1642752cc.slice/crio-f2bfb1fbc8807142b2da8b59f3a12591e16be7ee5966636a4551e080c6ed01ae WatchSource:0}: Error finding container f2bfb1fbc8807142b2da8b59f3a12591e16be7ee5966636a4551e080c6ed01ae: Status 404 returned error can't find the container with id f2bfb1fbc8807142b2da8b59f3a12591e16be7ee5966636a4551e080c6ed01ae
Nov 03 05:54:35.501719 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.501701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:54:35.503618 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.503606    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:54:35.509732 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:35.509712    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25e9f30_3ae1_4319_a77a_708295d60f0f.slice/crio-1acb5cc9c10eec372edd0e218211d54aacea9f5ef62bdd8b1aed9b33c43ac1c0 WatchSource:0}: Error finding container 1acb5cc9c10eec372edd0e218211d54aacea9f5ef62bdd8b1aed9b33c43ac1c0: Status 404 returned error can't find the container with id 1acb5cc9c10eec372edd0e218211d54aacea9f5ef62bdd8b1aed9b33c43ac1c0
Nov 03 05:54:35.509909 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:35.509885    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1a66d3_b7e0_4e4d_beb0_f64d3212543a.slice/crio-5a3832a04a9d6b5593417b31f1ce8d77ae4ccf0c78c2a850657cd489b92ff3ce WatchSource:0}: Error finding container 5a3832a04a9d6b5593417b31f1ce8d77ae4ccf0c78c2a850657cd489b92ff3ce: Status 404 returned error can't find the container with id 5a3832a04a9d6b5593417b31f1ce8d77ae4ccf0c78c2a850657cd489b92ff3ce
Nov 03 05:54:35.512166 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:35.512131    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759c2efb_9378_426a_9f2b_2ee9179c84ca.slice/crio-9aa4a5a2929ad1d32b6766ba7727ddc24416cfe5b42a83ddaa2d32bb4cf50529 WatchSource:0}: Error finding container 9aa4a5a2929ad1d32b6766ba7727ddc24416cfe5b42a83ddaa2d32bb4cf50529: Status 404 returned error can't find the container with id 9aa4a5a2929ad1d32b6766ba7727ddc24416cfe5b42a83ddaa2d32bb4cf50529
Nov 03 05:54:35.515210 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:54:35.515032    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c654a48_02bf_4015_85e1_be3bf1ef9b12.slice/crio-978f03068abb7e0a5a446fd30dfb34a9ae53e5531b269cd7c2cb160e87655702 WatchSource:0}: Error finding container 978f03068abb7e0a5a446fd30dfb34a9ae53e5531b269cd7c2cb160e87655702: Status 404 returned error can't find the container with id 978f03068abb7e0a5a446fd30dfb34a9ae53e5531b269cd7c2cb160e87655702
Nov 03 05:54:35.839871 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.838880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:35.839871 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.839150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:35.839871 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.839082    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:35.839871 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.839360    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret podName:44da4b70-4f4c-4cdf-8be7-684f68743c76 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:36.839342327 +0000 UTC m=+4.140271671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret") pod "global-pull-secret-syncer-t477r" (UID: "44da4b70-4f4c-4cdf-8be7-684f68743c76") : object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:35.839871 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.839286    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:35.839871 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.839796    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:54:36.839781563 +0000 UTC m=+4.140710908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:35.940291 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:35.939651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:35.940291 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.939823    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 05:54:35.940291 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.939842    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 05:54:35.940291 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.939854    2575 projected.go:196] Error preparing data for projected volume kube-api-access-ccthw for pod openshift-network-diagnostics/network-check-target-8669x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:35.940291 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:35.939906    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw podName:b679ae94-3889-42b9-92f5-41793768bd69 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:36.939889946 +0000 UTC m=+4.240819290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccthw" (UniqueName: "kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw") pod "network-check-target-8669x" (UID: "b679ae94-3889-42b9-92f5-41793768bd69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:36.178650 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.178553    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 05:49:34 +0000 UTC" deadline="2028-05-07 15:21:13.214216187 +0000 UTC"
Nov 03 05:54:36.178650 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.178610    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13233h26m37.035609382s"
Nov 03 05:54:36.207353 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.207318    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal" event={"ID":"64792e0a2fa5247cd6cb1dcb331e5e11","Type":"ContainerStarted","Data":"9d512a761e646b6a0be1b741f50adfffdfdf74740bfb291c9ebef8c0b9306f09"}
Nov 03 05:54:36.215481 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.215393    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2h7wj" event={"ID":"4c654a48-02bf-4015-85e1-be3bf1ef9b12","Type":"ContainerStarted","Data":"978f03068abb7e0a5a446fd30dfb34a9ae53e5531b269cd7c2cb160e87655702"}
Nov 03 05:54:36.225911 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.225881    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerStarted","Data":"9aa4a5a2929ad1d32b6766ba7727ddc24416cfe5b42a83ddaa2d32bb4cf50529"}
Nov 03 05:54:36.245668 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.245635    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hjb7w" event={"ID":"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a","Type":"ContainerStarted","Data":"5a3832a04a9d6b5593417b31f1ce8d77ae4ccf0c78c2a850657cd489b92ff3ce"}
Nov 03 05:54:36.254273 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.254244    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hcd9r" event={"ID":"a25e9f30-3ae1-4319-a77a-708295d60f0f","Type":"ContainerStarted","Data":"1acb5cc9c10eec372edd0e218211d54aacea9f5ef62bdd8b1aed9b33c43ac1c0"}
Nov 03 05:54:36.258892 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.258837    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98" event={"ID":"fc6f8642-bdd0-42b6-a018-98a1642752cc","Type":"ContainerStarted","Data":"f2bfb1fbc8807142b2da8b59f3a12591e16be7ee5966636a4551e080c6ed01ae"}
Nov 03 05:54:36.269316 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.269270    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zn76c" event={"ID":"180ebbd8-f149-4418-b609-572389c6d617","Type":"ContainerStarted","Data":"89cc75951f10a06dad2767951bacd6324d9bebb7fbd7b9cc21505cdb53d3c9bc"}
Nov 03 05:54:36.275374 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.275351    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tfmns" event={"ID":"c6083fc7-5b1c-42f1-831e-9a95857c0720","Type":"ContainerStarted","Data":"ff865fe27b055b0d71c7dbaf9abd581d59fcc977f53977821ceaea7176a6af96"}
Nov 03 05:54:36.288838 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.288814    2575 generic.go:356] "Generic (PLEG): container finished" podID="3cadd07d0bc5cca312fe70e95ea81342" containerID="74d382ed8350f2dd20d38b1187bb36126a743a9cd9ae58a79a3e6609ecfc1b5b" exitCode=0
Nov 03 05:54:36.288929 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.288884    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal" event={"ID":"3cadd07d0bc5cca312fe70e95ea81342","Type":"ContainerDied","Data":"74d382ed8350f2dd20d38b1187bb36126a743a9cd9ae58a79a3e6609ecfc1b5b"}
Nov 03 05:54:36.302888 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.302825    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"5bc345cc8bfa45c624c845f8fcc953f9a35ee01cdb8c2e616de2d7da5dbf21c0"}
Nov 03 05:54:36.314400 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.314335    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgzqf" event={"ID":"1d206e49-6bf6-4139-8e0f-02e7840cec50","Type":"ContainerStarted","Data":"385a4736e5fdf0c2293938f0ad8ddb4fb39784fbfc5440433174e0040f3c2ea5"}
Nov 03 05:54:36.331139 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.330470    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal" podStartSLOduration=2.330454313 podStartE2EDuration="2.330454313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:36.248073396 +0000 UTC m=+3.549002748" watchObservedRunningTime="2026-11-03 05:54:36.330454313 +0000 UTC m=+3.631383662"
Nov 03 05:54:36.846673 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.846601    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:36.846879 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.846679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:36.846879 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.846796    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:36.846879 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.846851    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret podName:44da4b70-4f4c-4cdf-8be7-684f68743c76 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:38.846835568 +0000 UTC m=+6.147764912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret") pod "global-pull-secret-syncer-t477r" (UID: "44da4b70-4f4c-4cdf-8be7-684f68743c76") : object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:36.847212 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.847193    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:36.847293 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.847244    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:54:38.847230216 +0000 UTC m=+6.148159563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:36.947480 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:36.947447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:36.947640 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.947629    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 05:54:36.947713 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.947648    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 05:54:36.947713 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.947666    2575 projected.go:196] Error preparing data for projected volume kube-api-access-ccthw for pod openshift-network-diagnostics/network-check-target-8669x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:36.947799 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:36.947723    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw podName:b679ae94-3889-42b9-92f5-41793768bd69 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:38.947703486 +0000 UTC m=+6.248632832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccthw" (UniqueName: "kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw") pod "network-check-target-8669x" (UID: "b679ae94-3889-42b9-92f5-41793768bd69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:37.182571 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:37.179685    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 05:49:34 +0000 UTC" deadline="2028-07-07 11:34:56.829223287 +0000 UTC"
Nov 03 05:54:37.182571 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:37.179743    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14693h40m19.649483707s"
Nov 03 05:54:37.197029 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:37.196991    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:37.197221 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:37.197128    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:37.197538 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:37.197518    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:37.197617 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:37.197597    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:37.197664 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:37.197655    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:37.197728 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:37.197714    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:37.346527 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:37.346284    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal" event={"ID":"3cadd07d0bc5cca312fe70e95ea81342","Type":"ContainerStarted","Data":"343c9d410fb5b5ab75bac5c0c3b5c2a657144f72e3bc69f360651ffe8ebd94ab"}
Nov 03 05:54:38.353707 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:38.353671    2575 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="824e42f37ef9ae112a3f143475f6664c7d6fdf1ea59282ab601af686fafa452c" exitCode=0
Nov 03 05:54:38.354781 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:38.354718    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerDied","Data":"824e42f37ef9ae112a3f143475f6664c7d6fdf1ea59282ab601af686fafa452c"}
Nov 03 05:54:38.432663 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:38.432607    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal" podStartSLOduration=4.432587084 podStartE2EDuration="4.432587084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:37.386072559 +0000 UTC m=+4.687001907" watchObservedRunningTime="2026-11-03 05:54:38.432587084 +0000 UTC m=+5.733516444"
Nov 03 05:54:38.862515 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:38.862471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:38.862672 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:38.862576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:38.862729 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.862701    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:38.862776 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.862759    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret podName:44da4b70-4f4c-4cdf-8be7-684f68743c76 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:42.862743084 +0000 UTC m=+10.163672432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret") pod "global-pull-secret-syncer-t477r" (UID: "44da4b70-4f4c-4cdf-8be7-684f68743c76") : object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:38.863204 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.863183    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:38.863295 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.863250    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:54:42.863233032 +0000 UTC m=+10.164162387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:38.963683 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:38.963652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:38.963869 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.963853    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 05:54:38.963944 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.963879    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 05:54:38.963944 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.963892    2575 projected.go:196] Error preparing data for projected volume kube-api-access-ccthw for pod openshift-network-diagnostics/network-check-target-8669x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:38.964041 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:38.963945    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw podName:b679ae94-3889-42b9-92f5-41793768bd69 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:42.963927374 +0000 UTC m=+10.264856725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccthw" (UniqueName: "kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw") pod "network-check-target-8669x" (UID: "b679ae94-3889-42b9-92f5-41793768bd69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:39.194406 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:39.193606    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:39.194406 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:39.193614    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:39.194406 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:39.193748    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:39.194406 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:39.193995    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:39.194406 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:39.194071    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:39.194406 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:39.194162    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:39.369518 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:39.369451    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hcd9r" event={"ID":"a25e9f30-3ae1-4319-a77a-708295d60f0f","Type":"ContainerStarted","Data":"691d822bdd8ce23dded54858fbd3c87dfe412055644f1648cb15fd67838afdea"}
Nov 03 05:54:40.382424 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:40.382300    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zn76c" event={"ID":"180ebbd8-f149-4418-b609-572389c6d617","Type":"ContainerStarted","Data":"99a77dd4c907e3559b0f67a122580ea8f26ad32406701a0d125bbd8381c1ed3f"}
Nov 03 05:54:40.425991 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:40.424980    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hcd9r" podStartSLOduration=4.009412581 podStartE2EDuration="7.424961185s" totalImagesPullingTime="3.415548604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:39.413528708 +0000 UTC m=+6.714458059" watchObservedRunningTime="2026-11-03 05:54:40.424961185 +0000 UTC m=+7.725890539"
Nov 03 05:54:41.194117 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:41.193618    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:41.194117 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:41.193627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:41.194117 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:41.193777    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:41.194117 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:41.193891    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:41.194117 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:41.194005    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:41.194117 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:41.194073    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:41.387107 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:41.387030    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98" event={"ID":"fc6f8642-bdd0-42b6-a018-98a1642752cc","Type":"ContainerStarted","Data":"54d215750f45cfc555393fd4a353f00f8b724b6f056a98a2a0c502789ce2301e"}
Nov 03 05:54:42.392772 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:42.392733    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tfmns" event={"ID":"c6083fc7-5b1c-42f1-831e-9a95857c0720","Type":"ContainerStarted","Data":"469c14de63e078dd1e578e6855bbf031cf05c896318f08a8929667824b62221b"}
Nov 03 05:54:42.440053 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:42.439965    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zn76c" podStartSLOduration=5.864733944 podStartE2EDuration="10.439950517s" totalImagesPullingTime="4.575216573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:40.425970437 +0000 UTC m=+7.726899792" watchObservedRunningTime="2026-11-03 05:54:42.439950517 +0000 UTC m=+9.740879866"
Nov 03 05:54:42.743879 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:42.743833    2575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 05:54:42.895739 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:42.895705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:42.895862 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:42.895794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:42.895929 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.895912    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:42.895986 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.895973    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret podName:44da4b70-4f4c-4cdf-8be7-684f68743c76 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:50.895957925 +0000 UTC m=+18.196887256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret") pod "global-pull-secret-syncer-t477r" (UID: "44da4b70-4f4c-4cdf-8be7-684f68743c76") : object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:42.896364 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.896346    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:42.896442 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.896403    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:54:50.896386859 +0000 UTC m=+18.197316196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:42.996987 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:42.996956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:42.997185 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.997141    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 05:54:42.997185 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.997163    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 05:54:42.997185 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.997178    2575 projected.go:196] Error preparing data for projected volume kube-api-access-ccthw for pod openshift-network-diagnostics/network-check-target-8669x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:42.997356 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:42.997229    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw podName:b679ae94-3889-42b9-92f5-41793768bd69 nodeName:}" failed. No retries permitted until 2026-11-03 05:54:50.997212174 +0000 UTC m=+18.298141519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccthw" (UniqueName: "kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw") pod "network-check-target-8669x" (UID: "b679ae94-3889-42b9-92f5-41793768bd69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:43.184542 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.184225    2575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T05:54:42.743876606Z","UUID":"280ae9e7-4686-45a8-adec-5f6a4b8e56e3","Handler":null,"Name":"","Endpoint":""}
Nov 03 05:54:43.193097 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.190657    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 05:54:43.193097 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.190686    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 05:54:43.196206 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.196182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:43.196316 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:43.196294    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:43.196964 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.196641    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:43.196964 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:43.196748    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:43.196964 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.196770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:43.196964 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:43.196849    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:43.398359 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.398327    2575 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="66c423bf3227653ead21bf1fa023a10ee7285db0f1774c19b5e0d8ca1db18928" exitCode=0
Nov 03 05:54:43.398858 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.398396    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerDied","Data":"66c423bf3227653ead21bf1fa023a10ee7285db0f1774c19b5e0d8ca1db18928"}
Nov 03 05:54:43.401859 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.401839    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hjb7w" event={"ID":"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a","Type":"ContainerStarted","Data":"c16ed2a571705a7003556800d3a639609cc6644e6b828fb8db9c8bf7916c6a89"}
Nov 03 05:54:43.405931 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.405913    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98" event={"ID":"fc6f8642-bdd0-42b6-a018-98a1642752cc","Type":"ContainerStarted","Data":"d2ea86a8b0476842113a5ccbd904fa2885139930c5fa62259c57c13118ddad6c"}
Nov 03 05:54:43.449855 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.449094    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-tfmns" podStartSLOduration=4.740994064 podStartE2EDuration="11.449076254s" totalImagesPullingTime="6.70808219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:42.440806075 +0000 UTC m=+9.741735428" watchObservedRunningTime="2026-11-03 05:54:43.449076254 +0000 UTC m=+10.750005610"
Nov 03 05:54:43.491695 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.491610    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-hjb7w" podStartSLOduration=2.937096829 podStartE2EDuration="10.491593106s" totalImagesPullingTime="7.554496277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:43.491110202 +0000 UTC m=+10.792039555" watchObservedRunningTime="2026-11-03 05:54:43.491593106 +0000 UTC m=+10.792522460"
Nov 03 05:54:43.611541 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.611487    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:43.612032 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:43.612013    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:44.410050 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:44.410018    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2h7wj" event={"ID":"4c654a48-02bf-4015-85e1-be3bf1ef9b12","Type":"ContainerStarted","Data":"7a48993b8b4fb40a6dfa62146162cacf5db3daf67d7cfddf6e0837ba168026ea"}
Nov 03 05:54:44.412626 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:44.412596    2575 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="49b8272944ceb8831cac2d531abcf96ff36c4bf3df2f0ec29226e0a3d47a9663" exitCode=0
Nov 03 05:54:44.412756 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:44.412679    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerDied","Data":"49b8272944ceb8831cac2d531abcf96ff36c4bf3df2f0ec29226e0a3d47a9663"}
Nov 03 05:54:44.415392 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:44.415334    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98" event={"ID":"fc6f8642-bdd0-42b6-a018-98a1642752cc","Type":"ContainerStarted","Data":"e0573a895d46bde4fa5c339a685ab7f19ec047eacfaa521d7464a5d5cd55eb4a"}
Nov 03 05:54:44.453423 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:44.453379    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2h7wj" podStartSLOduration=4.1857501169999995 podStartE2EDuration="11.45336647s" totalImagesPullingTime="7.267616353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:44.452765223 +0000 UTC m=+11.753694576" watchObservedRunningTime="2026-11-03 05:54:44.45336647 +0000 UTC m=+11.754295828"
Nov 03 05:54:44.498451 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:44.498397    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98" podStartSLOduration=3.7183558420000002 podStartE2EDuration="11.498379929s" totalImagesPullingTime="7.780024087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:44.49831728 +0000 UTC m=+11.799246633" watchObservedRunningTime="2026-11-03 05:54:44.498379929 +0000 UTC m=+11.799309283"
Nov 03 05:54:45.193084 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:45.193051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:45.193232 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:45.193088    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:45.193232 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:45.193181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:45.193330 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:45.193298    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:45.193407 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:45.193374    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:45.193483 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:45.193460    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:45.418345 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:45.418310    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgzqf" event={"ID":"1d206e49-6bf6-4139-8e0f-02e7840cec50","Type":"ContainerStarted","Data":"32c3e01b3a750bd3535c53b07ae759d2d227b770c9188c418b4d4c9b9ee06fd6"}
Nov 03 05:54:45.422921 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:45.422403    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerStarted","Data":"31358dfefdc0484d40c19c991a260560592e0c5b26dcf2f363bb0f6874bf9707"}
Nov 03 05:54:45.463882 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:45.463808    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zgzqf" podStartSLOduration=3.638767486 podStartE2EDuration="13.463795015s" totalImagesPullingTime="9.825027529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:45.463366807 +0000 UTC m=+12.764296159" watchObservedRunningTime="2026-11-03 05:54:45.463795015 +0000 UTC m=+12.764724367"
Nov 03 05:54:46.427180 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:46.427147    2575 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="31358dfefdc0484d40c19c991a260560592e0c5b26dcf2f363bb0f6874bf9707" exitCode=0
Nov 03 05:54:46.427805 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:46.427225    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerDied","Data":"31358dfefdc0484d40c19c991a260560592e0c5b26dcf2f363bb0f6874bf9707"}
Nov 03 05:54:47.192983 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:47.192792    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:47.193121 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:47.192794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:47.193121 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:47.193096    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:47.193230 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:47.192811    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:47.193230 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:47.193160    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:47.193230 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:47.193217    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:47.432182 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:47.432150    2575 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="4e30159ea58911fe8e8dec948cf76ae46680e032ab85754dc4fdaba3d7fb30dd" exitCode=0
Nov 03 05:54:47.432603 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:47.432208    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerDied","Data":"4e30159ea58911fe8e8dec948cf76ae46680e032ab85754dc4fdaba3d7fb30dd"}
Nov 03 05:54:48.438263 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:48.438195    2575 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="f3798052eefbf542832cc0aae7a1d306dedf72572a7b06b069d15fcc0029e108" exitCode=0
Nov 03 05:54:48.438263 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:48.438235    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerDied","Data":"f3798052eefbf542832cc0aae7a1d306dedf72572a7b06b069d15fcc0029e108"}
Nov 03 05:54:49.192914 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:49.192884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:49.192914 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:49.192911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:49.193148 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:49.193012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:49.193148 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:49.193033    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:49.193148 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:49.193078    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:49.193286 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:49.193147    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:49.443742 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:49.443669    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" event={"ID":"759c2efb-9378-426a-9f2b-2ee9179c84ca","Type":"ContainerStarted","Data":"0e25883ef0db1dc6365e68fed1962d300c6746a36214f9be4854561f19f94f68"}
Nov 03 05:54:49.521580 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:49.521542    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7fb9t" podStartSLOduration=6.953675701 podStartE2EDuration="16.521527955s" totalImagesPullingTime="9.567852254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:49.50726759 +0000 UTC m=+16.808196954" watchObservedRunningTime="2026-11-03 05:54:49.521527955 +0000 UTC m=+16.822457309"
Nov 03 05:54:50.448595 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.448412    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"7ae12906d170ca2d21cd5f7d74ed4756433c1355e8a9f65692a263913edaf16b"}
Nov 03 05:54:50.448938 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.448630    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"ccf00999fa445a729d98b96457a00583d45812638b44442c46ac313e53b3a1c9"}
Nov 03 05:54:50.448938 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.448664    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"8d3d2a85908fb8a6aa76c8207f82330f67da094833fda2e8f201ed3ff56e240d"}
Nov 03 05:54:50.448938 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.448693    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"c715b62a974394c2086225082d95dbc554f2d16fe17aae79bc2d5ebe5b88cd65"}
Nov 03 05:54:50.448938 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.448720    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"bdd78b41d9ffe5393fe0fdfee30a5b66b4c8d2ed5823ad4ee8161b96ed926b84"}
Nov 03 05:54:50.448938 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.448758    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"7485c8fea5d93a651eaa276c5e014976549c8caf1fa080d75197b90bfc51404a"}
Nov 03 05:54:50.954990 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.954960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:50.955171 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:50.955000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:50.955171 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:50.955102    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:50.955171 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:50.955141    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:50.955171 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:50.955156    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret podName:44da4b70-4f4c-4cdf-8be7-684f68743c76 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:06.955143223 +0000 UTC m=+34.256072556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret") pod "global-pull-secret-syncer-t477r" (UID: "44da4b70-4f4c-4cdf-8be7-684f68743c76") : object "kube-system"/"original-pull-secret" not registered
Nov 03 05:54:50.955327 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:50.955178    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:55:06.955168002 +0000 UTC m=+34.256097333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 05:54:51.055763 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:51.055733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:51.055880 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:51.055844    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 05:54:51.055880 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:51.055859    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 05:54:51.055880 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:51.055868    2575 projected.go:196] Error preparing data for projected volume kube-api-access-ccthw for pod openshift-network-diagnostics/network-check-target-8669x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:51.056000 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:51.055908    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw podName:b679ae94-3889-42b9-92f5-41793768bd69 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:07.055896947 +0000 UTC m=+34.356826292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccthw" (UniqueName: "kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw") pod "network-check-target-8669x" (UID: "b679ae94-3889-42b9-92f5-41793768bd69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 05:54:51.193051 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:51.193014    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:51.193051 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:51.193037    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:51.193209 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:51.193067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:51.193209 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:51.193155    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:51.193209 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:51.193188    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:51.193311 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:51.193273    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:52.455577 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:52.455548    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"28c0c13fd2c924da5db895d82bfa610054cf9484af8e9eef6df1a279515a1550"}
Nov 03 05:54:53.193221 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:53.193194    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:53.193388 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:53.193280    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:53.193388 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:53.193353    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:53.193460 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:53.193438    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:53.193492 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:53.193469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:53.193626 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:53.193606    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:53.556856 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:53.556778    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:53.557309 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:53.556907    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 05:54:53.557356 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:53.557328    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:54:54.463287 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:54.463246    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" event={"ID":"801a6f81-0e55-40e6-8740-2ab8bcf0cad8","Type":"ContainerStarted","Data":"1dd593166805105ebbb22ff44a81ce14c16524bf377c505d188af1166f3a49f9"}
Nov 03 05:54:54.463471 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:54.463453    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:54.463561 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:54.463549    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:54.478913 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:54.478888    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:54.561881 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:54.561826    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt" podStartSLOduration=7.594809523 podStartE2EDuration="21.561812458s" totalImagesPullingTime="13.967002935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 05:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:54:54.561347146 +0000 UTC m=+21.862276500" watchObservedRunningTime="2026-11-03 05:54:54.561812458 +0000 UTC m=+21.862741845"
Nov 03 05:54:55.192585 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.192557    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:55.192585 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.192582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:55.192811 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:55.192656    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:55.192811 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.192712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:55.192811 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:55.192791    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:55.192959 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:55.192857    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:55.466059 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.465991    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:55.481213 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.481048    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:54:55.988692 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.988652    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8669x"]
Nov 03 05:54:55.989166 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.988793    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:55.989166 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:55.988907    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:55.989456 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.989434    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t477r"]
Nov 03 05:54:55.989548 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.989540    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:55.989665 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:55.989648    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:55.992351 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.992321    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-42ps6"]
Nov 03 05:54:55.992435 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:55.992416    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:55.992556 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:55.992535    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:57.192939 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:57.192900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:57.193486 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:57.193040    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:57.193486 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:57.193083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:57.193486 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:57.193166    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:54:58.192422 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:58.192396    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:54:58.192571 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:58.192488    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:54:59.193444 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:59.193407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:54:59.193856 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:59.193549    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:54:59.193856 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:54:59.193600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:54:59.193856 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:54:59.193688    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:55:00.192641 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:00.192600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:00.192859 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:00.192706    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8669x" podUID="b679ae94-3889-42b9-92f5-41793768bd69"
Nov 03 05:55:01.193036 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:01.192998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:01.193036 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:01.192998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:01.193488 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:01.193144    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-42ps6" podUID="e4e3fb98-d6df-4769-8ee4-53219b93176e"
Nov 03 05:55:01.193488 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:01.193155    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t477r" podUID="44da4b70-4f4c-4cdf-8be7-684f68743c76"
Nov 03 05:55:02.010257 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.010230    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeReady"
Nov 03 05:55:02.010415 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.010375    2575 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 03 05:55:02.073414 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.073381    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:02.080641 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.080618    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-clgrr"]
Nov 03 05:55:02.083001 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.082985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.083895 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.083876    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7zjvt"]
Nov 03 05:55:02.087046 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.087028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.106408 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.106385    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 05:55:02.106593 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.106415    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 05:55:02.106593 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.106428    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 05:55:02.107014 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.106994    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clgrr"]
Nov 03 05:55:02.111886 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.111865    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zjvt"]
Nov 03 05:55:02.115135 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.115116    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 05:55:02.115237 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.115172    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hwk29\""
Nov 03 05:55:02.115237 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.115191    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 05:55:02.115237 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.115227    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-xj6m8\""
Nov 03 05:55:02.193090 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.193057    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:02.211805 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.211787    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 05:55:02.211994 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.211980    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 05:55:02.212116 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.212103    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-xvf66\""
Nov 03 05:55:02.235884 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.235814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c60201-2d6d-4914-950f-632901f554a3-cert\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.235884 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.235847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.235884 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.235864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-config-volume\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.235884 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.235884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-tmp-dir\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.236088 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.235990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kdz\" (UniqueName: \"kubernetes.io/projected/e5c60201-2d6d-4914-950f-632901f554a3-kube-api-access-x5kdz\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.236088 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.236024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wtrk\" (UniqueName: \"kubernetes.io/projected/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-kube-api-access-7wtrk\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.299421 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.299389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:02.337311 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.337283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wtrk\" (UniqueName: \"kubernetes.io/projected/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-kube-api-access-7wtrk\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.337469 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.337327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c60201-2d6d-4914-950f-632901f554a3-cert\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.337469 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.337348    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.337469 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.337370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-config-volume\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.337469 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.337399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-tmp-dir\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.337469 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.337435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kdz\" (UniqueName: \"kubernetes.io/projected/e5c60201-2d6d-4914-950f-632901f554a3-kube-api-access-x5kdz\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.337469 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:02.337442    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:02.337723 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:02.337524    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:02.83748859 +0000 UTC m=+30.138417938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:02.337801 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.337783    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-tmp-dir\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.338109 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.338086    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-config-volume\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.341487 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.341465    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c60201-2d6d-4914-950f-632901f554a3-cert\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.365270 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.365242    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kdz\" (UniqueName: \"kubernetes.io/projected/e5c60201-2d6d-4914-950f-632901f554a3-kube-api-access-x5kdz\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.367147 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.367124    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wtrk\" (UniqueName: \"kubernetes.io/projected/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-kube-api-access-7wtrk\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.395664 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.395640    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:02.704492 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.703976    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clgrr"]
Nov 03 05:55:02.707075 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:55:02.707051    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c60201_2d6d_4914_950f_632901f554a3.slice/crio-05dc2ead3b00f7d111a0a4383fd80b58a55248301aaf312d41faaf67f13e255e WatchSource:0}: Error finding container 05dc2ead3b00f7d111a0a4383fd80b58a55248301aaf312d41faaf67f13e255e: Status 404 returned error can't find the container with id 05dc2ead3b00f7d111a0a4383fd80b58a55248301aaf312d41faaf67f13e255e
Nov 03 05:55:02.841488 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:02.841459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:02.841657 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:02.841571    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:02.841657 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:02.841621    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:03.841609025 +0000 UTC m=+31.142538369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:03.194100 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.194071    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:03.194753 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.194233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:03.211079 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.211054    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rwdxr\""
Nov 03 05:55:03.211173 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.211107    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 05:55:03.211241 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.211228    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mlps4\""
Nov 03 05:55:03.211327 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.211313    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 05:55:03.485188 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.485108    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clgrr" event={"ID":"e5c60201-2d6d-4914-950f-632901f554a3","Type":"ContainerStarted","Data":"05dc2ead3b00f7d111a0a4383fd80b58a55248301aaf312d41faaf67f13e255e"}
Nov 03 05:55:03.849118 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.849040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:03.849251 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:03.849192    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:03.849300 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:03.849261    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:05.849245467 +0000 UTC m=+33.150174799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:03.942126 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:03.942088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:05.864029 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:05.863994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:05.864547 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:05.864157    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:05.864547 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:05.864226    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:09.864209404 +0000 UTC m=+37.165138735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:06.042219 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:06.042189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:06.205457 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:06.205417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:06.493563 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:06.493529    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clgrr" event={"ID":"e5c60201-2d6d-4914-950f-632901f554a3","Type":"ContainerStarted","Data":"481a9e45eb2315f7dc2bc6023d2d6f1f30fc3e6e5c374532b0c9b5649f1ce475"}
Nov 03 05:55:06.536756 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:06.536590    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-clgrr" podStartSLOduration=1.824654043 podStartE2EDuration="4.536578402s" totalImagesPullingTime="2.711924359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:06.536427597 +0000 UTC m=+33.837356950" watchObservedRunningTime="2026-11-03 05:55:06.536578402 +0000 UTC m=+33.837507754"
Nov 03 05:55:06.969647 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:06.969608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:06.970100 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:06.969670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:06.970100 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:06.969808    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 05:55:06.970100 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:06.969881    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:55:38.969862042 +0000 UTC m=+66.270791390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : secret "metrics-daemon-secret" not found
Nov 03 05:55:06.972280 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:06.972249    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:07.070925 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:07.070889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:07.073434 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:07.073406    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:07.119530 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:07.119482    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:07.306031 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:07.305988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:07.470659 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:07.470633    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t477r"]
Nov 03 05:55:07.472119 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:55:07.472067    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44da4b70_4f4c_4cdf_8be7_684f68743c76.slice/crio-1d564d3700cf5531f75d449f7abcc877e229c8a03c13fc800fcccb3574c01af4 WatchSource:0}: Error finding container 1d564d3700cf5531f75d449f7abcc877e229c8a03c13fc800fcccb3574c01af4: Status 404 returned error can't find the container with id 1d564d3700cf5531f75d449f7abcc877e229c8a03c13fc800fcccb3574c01af4
Nov 03 05:55:07.496941 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:07.496913    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t477r" event={"ID":"44da4b70-4f4c-4cdf-8be7-684f68743c76","Type":"ContainerStarted","Data":"1d564d3700cf5531f75d449f7abcc877e229c8a03c13fc800fcccb3574c01af4"}
Nov 03 05:55:07.618269 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:07.618244    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8669x"]
Nov 03 05:55:07.619429 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:55:07.619408    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb679ae94_3889_42b9_92f5_41793768bd69.slice/crio-b884b90e6e49c59b330517b5d8407bf6107a37ace592ca3d322f799d0fdb5fe1 WatchSource:0}: Error finding container b884b90e6e49c59b330517b5d8407bf6107a37ace592ca3d322f799d0fdb5fe1: Status 404 returned error can't find the container with id b884b90e6e49c59b330517b5d8407bf6107a37ace592ca3d322f799d0fdb5fe1
Nov 03 05:55:08.291440 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.291405    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dwm99"]
Nov 03 05:55:08.311170 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.311144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.322431 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.322358    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwm99"]
Nov 03 05:55:08.335642 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.335616    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 05:55:08.335642 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.335616    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 05:55:08.335814 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.335616    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 05:55:08.335814 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.335619    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 05:55:08.335814 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.335734    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j9vz5\""
Nov 03 05:55:08.381221 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.381192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad68c47-f589-44b7-831f-05e4d74ad98d-crio-socket\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.381391 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.381269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.381454 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.381388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad68c47-f589-44b7-831f-05e4d74ad98d-data-volume\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.381454 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.381428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.381584 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.381461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kp4v\" (UniqueName: \"kubernetes.io/projected/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-api-access-4kp4v\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.416793 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.416756    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:08.482597 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.482558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad68c47-f589-44b7-831f-05e4d74ad98d-data-volume\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.482794 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.482616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.482794 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.482643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kp4v\" (UniqueName: \"kubernetes.io/projected/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-api-access-4kp4v\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.482794 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.482690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad68c47-f589-44b7-831f-05e4d74ad98d-crio-socket\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.482794 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.482753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.483111 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.482883    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:08.483111 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.482947    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:08.982927566 +0000 UTC m=+36.283856904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:08.483539 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.483513    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad68c47-f589-44b7-831f-05e4d74ad98d-data-volume\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.483688 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.483650    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 05:55:08.483778 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.483709    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad68c47-f589-44b7-831f-05e4d74ad98d-crio-socket\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.483778 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.483748    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:08.983727211 +0000 UTC m=+36.284656560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : configmap "kube-rbac-proxy" not found
Nov 03 05:55:08.501462 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.501400    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8669x" event={"ID":"b679ae94-3889-42b9-92f5-41793768bd69","Type":"ContainerStarted","Data":"b884b90e6e49c59b330517b5d8407bf6107a37ace592ca3d322f799d0fdb5fe1"}
Nov 03 05:55:08.511594 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.511565    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kp4v\" (UniqueName: \"kubernetes.io/projected/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-api-access-4kp4v\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.599318 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.599245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:08.706480 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.706450    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"]
Nov 03 05:55:08.724384 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.723781    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"
Nov 03 05:55:08.745252 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.745227    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"]
Nov 03 05:55:08.748614 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.748530    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 03 05:55:08.748614 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.748536    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jcdvc\""
Nov 03 05:55:08.748614 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.748584    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 03 05:55:08.786909 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.786878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:08.885015 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.884977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmcm\" (UniqueName: \"kubernetes.io/projected/e0832f8b-30ec-40dd-bcdb-cddc19fd657d-kube-api-access-ghmcm\") pod \"migrator-66df5d496b-4rp7g\" (UID: \"e0832f8b-30ec-40dd-bcdb-cddc19fd657d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"
Nov 03 05:55:08.984589 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.984552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:08.985289 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.985262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmcm\" (UniqueName: \"kubernetes.io/projected/e0832f8b-30ec-40dd-bcdb-cddc19fd657d-kube-api-access-ghmcm\") pod \"migrator-66df5d496b-4rp7g\" (UID: \"e0832f8b-30ec-40dd-bcdb-cddc19fd657d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"
Nov 03 05:55:08.985428 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.985308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.985428 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:08.985371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:08.985561 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.985466    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:08.985633 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.985613    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 05:55:08.985694 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.985655    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:09.985635229 +0000 UTC m=+37.286564574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:08.985694 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:08.985676    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:09.985666254 +0000 UTC m=+37.286595597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : configmap "kube-rbac-proxy" not found
Nov 03 05:55:09.010866 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.010839    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmcm\" (UniqueName: \"kubernetes.io/projected/e0832f8b-30ec-40dd-bcdb-cddc19fd657d-kube-api-access-ghmcm\") pod \"migrator-66df5d496b-4rp7g\" (UID: \"e0832f8b-30ec-40dd-bcdb-cddc19fd657d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"
Nov 03 05:55:09.050687 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.050642    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"
Nov 03 05:55:09.369800 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.369767    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"]
Nov 03 05:55:09.383575 ip-10-0-138-242 kubenswrapper[2575]: W1103 05:55:09.383544    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0832f8b_30ec_40dd_bcdb_cddc19fd657d.slice/crio-644ac139208fd18278b752cdd3010279aa720c02a66a2cc9bb3bdb1beb96745b WatchSource:0}: Error finding container 644ac139208fd18278b752cdd3010279aa720c02a66a2cc9bb3bdb1beb96745b: Status 404 returned error can't find the container with id 644ac139208fd18278b752cdd3010279aa720c02a66a2cc9bb3bdb1beb96745b
Nov 03 05:55:09.506203 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.506164    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g" event={"ID":"e0832f8b-30ec-40dd-bcdb-cddc19fd657d","Type":"ContainerStarted","Data":"644ac139208fd18278b752cdd3010279aa720c02a66a2cc9bb3bdb1beb96745b"}
Nov 03 05:55:09.610395 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.610357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:09.777514 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.777406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:09.892774 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.892737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:09.892947 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:09.892903    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:09.893017 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:09.892982    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:17.892960373 +0000 UTC m=+45.193889728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:09.993413 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.993378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:09.993618 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:09.993423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:09.993618 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:09.993539    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 05:55:09.993618 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:09.993588    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:11.993574455 +0000 UTC m=+39.294503787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : configmap "kube-rbac-proxy" not found
Nov 03 05:55:09.993973 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:09.993957    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:09.994024 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:09.994012    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:11.9939978 +0000 UTC m=+39.294927140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:10.311069 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:10.311033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:11.512895 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:11.512817    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g" event={"ID":"e0832f8b-30ec-40dd-bcdb-cddc19fd657d","Type":"ContainerStarted","Data":"106eaffb6ccce4996df7a019fbcaf6e07b8143833ae09a3aa51b30bff451bcf9"}
Nov 03 05:55:11.514562 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:11.514530    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8669x" event={"ID":"b679ae94-3889-42b9-92f5-41793768bd69","Type":"ContainerStarted","Data":"b548d6775d8cd853eb640c92e5c004b18db5e82ae99c50d5cd1c1e109721abd6"}
Nov 03 05:55:11.514706 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:11.514670    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:11.556567 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:11.556517    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g" podStartSLOduration=1.707304183 podStartE2EDuration="3.55648495s" totalImagesPullingTime="1.849180767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:11.555318125 +0000 UTC m=+38.856247475" watchObservedRunningTime="2026-11-03 05:55:11.55648495 +0000 UTC m=+38.857414307"
Nov 03 05:55:11.599166 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:11.599112    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8669x" podStartSLOduration=34.971957728 podStartE2EDuration="38.599099075s" totalImagesPullingTime="3.627141347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:11.598275203 +0000 UTC m=+38.899204556" watchObservedRunningTime="2026-11-03 05:55:11.599099075 +0000 UTC m=+38.900028427"
Nov 03 05:55:12.006958 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:12.006921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:12.007122 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:12.006965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:12.007122 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:12.007042    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 03 05:55:12.007122 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:12.007092    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:12.007228 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:12.007099    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:16.007085855 +0000 UTC m=+43.308015199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : configmap "kube-rbac-proxy" not found
Nov 03 05:55:12.007228 ip-10-0-138-242 kubenswrapper[2575]: E1103 05:55:12.007189    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:16.007170547 +0000 UTC m=+43.308099882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:12.518830 ip-10-0-138-242 kubenswrapper[2575]: I1103 05:55:12.518787    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t477r" event={"ID":"44da4b70-4f4c-4cdf-8be7-684f68743c76","Type":"ContainerStarted","Data":"44e1fb1e037549b801c45fc37079406f30a27fa2ddc0373384d869ea8772ceeb"}
Nov 03 05:55:12.559664 ip-10-0-138-242 systemd[1]: Stopping Kubernetes Kubelet...
Nov 03 05:55:12.584911 ip-10-0-138-242 systemd[1]: kubelet.service: Deactivated successfully.
Nov 03 05:55:12.585078 ip-10-0-138-242 systemd[1]: Stopped Kubernetes Kubelet.
Nov 03 05:55:12.585132 ip-10-0-138-242 systemd[1]: kubelet.service: Consumed 2.250s CPU time.
Nov 03 05:55:12.600968 ip-10-0-138-242 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 05:55:12.702973 ip-10-0-138-242 kubenswrapper[4418]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 05:55:12.702973 ip-10-0-138-242 kubenswrapper[4418]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 05:55:12.702973 ip-10-0-138-242 kubenswrapper[4418]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 05:55:12.702973 ip-10-0-138-242 kubenswrapper[4418]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 05:55:12.705071 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.704992    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.705071 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705071    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705076    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705080    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705083    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705085    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705088    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705098    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705101    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705104    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705107    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705109    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705112    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705114    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705117    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705120    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705122    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705125    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705127    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705130    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705133    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.705140 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705135    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705138    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705141    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705144    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705147    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705150    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705152    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705155    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705159    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705163    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705166    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705170    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705173    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705176    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705179    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705182    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705185    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705188    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705192    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705194    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.705639 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705197    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705199    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705202    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705204    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705207    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705209    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705212    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705214    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705217    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705220    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705222    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705227    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705230    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705233    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705236    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705239    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705242    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705245    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705248    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.706105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705251    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705254    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705256    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705259    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705261    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705264    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705267    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705269    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705272    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705274    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705277    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705279    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705282    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705285    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705288    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705291    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705293    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705296    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705298    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705301    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.706604 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705303    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705306    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705308    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705311    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705314    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705316    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705319    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705321    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705324    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705326    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705329    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705331    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705334    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705336    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705339    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705341    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705344    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705346    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705349    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.707082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705351    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705354    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705356    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705359    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705362    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705364    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.705368    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706154    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706163    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706166    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706169    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706172    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706175    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706177    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706180    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706182    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706185    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706187    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706190    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706193    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.707570 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706195    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706198    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706200    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706202    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706205    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706208    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706210    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706213    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706217    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706221    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706225    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706228    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706232    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706236    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706239    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706242    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706244    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706247    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706249    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.708061 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706253    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706256    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706259    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706261    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706264    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706267    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706270    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706273    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706275    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706278    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706280    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706283    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706285    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706288    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706290    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706293    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706295    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706298    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706300    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706303    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.708529 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706305    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706307    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706310    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706312    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706315    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706317    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706320    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706323    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706326    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706328    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706331    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706334    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706337    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706344    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706347    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706349    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706352    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706354    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706357    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.709009 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706360    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706362    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706364    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706367    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706370    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706373    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706375    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706378    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706380    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706383    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706385    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706388    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706391    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706393    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706396    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706398    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706400    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706403    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706405    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706408    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.709466 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706411    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706413    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706416    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706418    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706422    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706424    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706427    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706430    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706432    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706435    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706438    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706440    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706443    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706446    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706449    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706959    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706966    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706970    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706972    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.709948 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706975    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706978    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706980    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706983    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706986    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706989    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706992    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706994    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706997    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.706999    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707002    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707005    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707007    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707010    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707013    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707017    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707021    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707025    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707028    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707031    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.710413 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707039    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707043    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707045    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707048    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707050    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707053    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707055    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707058    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707061    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707063    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707066    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707068    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707071    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707073    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707076    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707078    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707081    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707084    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707086    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707089    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.710964 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707092    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707095    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707098    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707100    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707103    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707105    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707108    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707112    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707114    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707117    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707119    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707122    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707124    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707132    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707135    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707138    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707140    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707144    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707148    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.711459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707151    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707154    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707156    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707159    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707161    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707165    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707167    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707170    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707172    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707175    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707177    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707182    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707184    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707187    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707189    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707192    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707194    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707197    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707199    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.711959 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707202    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707206    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707208    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707211    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707213    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707216    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707218    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707221    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707229    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707245    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707248    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707250    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707253    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707255    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707258    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707261    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707263    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707266    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707269    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.712407 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707272    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707274    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707276    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707279    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.707281    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707372    4418 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707379    4418 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707390    4418 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707396    4418 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707403    4418 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707408    4418 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707413    4418 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707416    4418 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707419    4418 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707424    4418 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707428    4418 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707431    4418 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707434    4418 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707437    4418 flags.go:64] FLAG: --cgroup-root=""
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707440    4418 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707443    4418 flags.go:64] FLAG: --client-ca-file=""
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707446    4418 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707457    4418 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 05:55:12.712865 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707464    4418 flags.go:64] FLAG: --cluster-domain=""
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707467    4418 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707470    4418 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707473    4418 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707476    4418 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707481    4418 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707484    4418 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707487    4418 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707490    4418 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707493    4418 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707496    4418 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707513    4418 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707519    4418 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707524    4418 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707530    4418 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707533    4418 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707536    4418 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707539    4418 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707542    4418 flags.go:64] FLAG: --enable-server="true"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707545    4418 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707552    4418 flags.go:64] FLAG: --event-burst="100"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707555    4418 flags.go:64] FLAG: --event-qps="50"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707558    4418 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707563    4418 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 05:55:12.713410 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707566    4418 flags.go:64] FLAG: --eviction-hard=""
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707570    4418 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707573    4418 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707576    4418 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707579    4418 flags.go:64] FLAG: --eviction-soft=""
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707582    4418 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707585    4418 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707588    4418 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707598    4418 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707601    4418 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707604    4418 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707606    4418 flags.go:64] FLAG: --feature-gates=""
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707610    4418 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707613    4418 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707616    4418 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707620    4418 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707623    4418 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707626    4418 flags.go:64] FLAG: --help="false"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707628    4418 flags.go:64] FLAG: --hostname-override="ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707632    4418 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707635    4418 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707638    4418 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707641    4418 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 05:55:12.714172 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707645    4418 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707648    4418 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707651    4418 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707653    4418 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707656    4418 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707659    4418 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707662    4418 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707665    4418 flags.go:64] FLAG: --kube-reserved=""
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707670    4418 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707672    4418 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707675    4418 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707678    4418 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707681    4418 flags.go:64] FLAG: --lock-file=""
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707683    4418 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707686    4418 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707689    4418 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707695    4418 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707697    4418 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707706    4418 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707709    4418 flags.go:64] FLAG: --logging-format="text"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707712    4418 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707715    4418 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707718    4418 flags.go:64] FLAG: --manifest-url=""
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707721    4418 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707725    4418 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 05:55:12.715080 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707728    4418 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707732    4418 flags.go:64] FLAG: --max-pods="110"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707735    4418 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707738    4418 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707741    4418 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707744    4418 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707747    4418 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707750    4418 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707753    4418 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707760    4418 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707763    4418 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707766    4418 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707769    4418 flags.go:64] FLAG: --pod-cidr=""
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707772    4418 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707775    4418 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707779    4418 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707782    4418 flags.go:64] FLAG: --port="10250"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707785    4418 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707788    4418 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dacf5a621e7b6716"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707791    4418 flags.go:64] FLAG: --qos-reserved=""
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707794    4418 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707797    4418 flags.go:64] FLAG: --register-node="true"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707800    4418 flags.go:64] FLAG: --register-with-taints=""
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707804    4418 flags.go:64] FLAG: --registry-burst="10"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707807    4418 flags.go:64] FLAG: --registry-qps="5"
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707810    4418 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 05:55:12.716211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707818    4418 flags.go:64] FLAG: --reserved-memory=""
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707823    4418 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707826    4418 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707829    4418 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707832    4418 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707834    4418 flags.go:64] FLAG: --runonce="false"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707838    4418 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707840    4418 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707843    4418 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707846    4418 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707849    4418 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707852    4418 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707855    4418 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707858    4418 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707861    4418 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707864    4418 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707867    4418 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707869    4418 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707873    4418 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707875    4418 flags.go:64] FLAG: --system-cgroups=""
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707878    4418 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707884    4418 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707887    4418 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707890    4418 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707897    4418 flags.go:64] FLAG: --tls-min-version=""
Nov 03 05:55:12.717444 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707899    4418 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707902    4418 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707905    4418 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707908    4418 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707911    4418 flags.go:64] FLAG: --v="2"
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707915    4418 flags.go:64] FLAG: --version="false"
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707919    4418 flags.go:64] FLAG: --vmodule=""
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707922    4418 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.707935    4418 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708123    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708127    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708130    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708133    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708136    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708138    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708141    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708144    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708146    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708149    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708151    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708154    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.718548 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708156    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708160    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708164    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708167    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708170    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708172    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708175    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708178    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708181    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708183    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708186    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708189    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708191    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708194    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708197    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708201    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708206    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708209    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708211    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708214    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.719491 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708222    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708225    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708228    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708231    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708233    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708236    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708238    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708241    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708243    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708246    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708248    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708251    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708254    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708256    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708259    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708261    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708264    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708266    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708269    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.720349 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708273    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708276    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708278    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708281    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708283    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708285    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708288    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708291    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708293    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708298    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708300    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708303    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708306    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708308    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708318    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708321    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708324    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708326    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708329    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708331    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.721167 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708334    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708337    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708339    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708342    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708344    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708346    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708349    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708351    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708354    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708356    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708359    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708362    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708366    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708368    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708371    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708373    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708376    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708378    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708381    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.721754 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708384    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708386    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708390    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708393    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708395    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708398    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708401    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708403    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708411    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708414    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708417    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708419    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708422    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708424    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708427    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708429    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.722334 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.708454    4418 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708513    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708519    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708524    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708528    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708531    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708534    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708536    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708539    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708544    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708546    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708550    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708552    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708555    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708558    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708560    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708564    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708568    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708571    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.722834 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708575    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708578    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708581    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708583    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708585    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708588    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708598    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708601    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708609    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708612    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708615    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708617    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708620    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708622    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708625    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708627    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708630    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708632    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708635    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.723295 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708637    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708640    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708642    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708646    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708649    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708651    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708654    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708657    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708659    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708662    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708664    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708667    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708670    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708674    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708676    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708679    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708682    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708684    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708687    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708689    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.723778 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708697    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708700    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708703    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708706    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708708    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708711    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708714    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708716    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708719    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708721    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708724    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708726    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708728    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708731    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708734    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708738    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708740    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708743    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708745    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.724358 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708748    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708751    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708753    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708756    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708758    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708761    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708765    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708768    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708770    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708773    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708775    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708778    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708781    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708784    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708792    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708795    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708797    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708800    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708803    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.724896 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708805    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708808    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708810    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708812    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708815    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708818    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708820    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708822    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708825    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708829    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.708831    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.713036    4418 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.713050    4418 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.713067    4418 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.713072    4418 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713169    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713174    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713177    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713180    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713183    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.725373 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713185    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713188    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713190    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713193    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713196    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713198    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713201    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713209    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713212    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713215    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713218    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713221    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713225    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713229    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713233    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713236    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713238    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713241    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713244    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.725865 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713248    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713251    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713254    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713258    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713262    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713265    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713268    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713271    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713273    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713276    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713278    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713281    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713283    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713286    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713288    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713291    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713293    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713296    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713298    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.726314 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713301    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713304    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713312    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713315    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713318    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713320    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713323    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713325    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713328    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713330    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713333    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713336    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713338    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713341    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713343    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713346    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713348    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713351    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713354    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713356    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.726940 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713359    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713362    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713364    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713367    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713369    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713372    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713374    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713376    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713379    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713382    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713384    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713387    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713389    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713392    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713394    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713402    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713405    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713408    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713410    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.735148 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713413    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713416    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713418    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713421    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713424    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713426    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713429    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713431    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713434    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713436    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713439    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713441    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713444    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713447    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713449    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713452    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713454    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713456    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713459    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713461    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.735672 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713464    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713466    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713469    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.713471    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.713497    4418 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715034    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715053    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715059    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715063    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715068    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715072    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715076    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715080    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715086    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715090    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.736137 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715094    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715101    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715108    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715114    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715118    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715123    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715128    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715132    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715142    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715146    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715150    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715155    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715159    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715164    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715168    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715172    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715177    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715181    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715186    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.736511 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715191    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715195    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715200    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715204    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715209    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715213    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715218    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715222    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715227    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715231    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715242    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715246    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715250    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715255    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715260    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715264    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715268    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715273    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715277    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715281    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.736976 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715286    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715302    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715309    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715313    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715319    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715323    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715328    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715332    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715336    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715341    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715346    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715351    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715356    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715360    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715364    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715368    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715373    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715377    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715381    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.737459 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715385    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715390    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715394    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715399    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715403    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715407    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715411    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715415    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715420    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715424    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715428    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715432    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715437    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715441    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715445    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715457    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715462    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715466    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715470    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715474    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.737937 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715478    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715483    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715487    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715492    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715497    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715517    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715521    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715525    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715530    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715534    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715538    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715543    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715547    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715551    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715556    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715560    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715564    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.738480 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715568    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.715614    4418 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715691    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715698    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715705    4418 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715709    4418 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715714    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715718    4418 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715722    4418 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715726    4418 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715731    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715743    4418 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715748    4418 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715753    4418 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715757    4418 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715761    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 05:55:12.738915 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715766    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715773    4418 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715779    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715783    4418 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715787    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715792    4418 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715797    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715801    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715805    4418 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715810    4418 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715814    4418 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715818    4418 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715822    4418 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715826    4418 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715830    4418 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715835    4418 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715839    4418 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715844    4418 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715848    4418 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 05:55:12.739302 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715852    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715856    4418 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715860    4418 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715864    4418 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715868    4418 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715872    4418 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715876    4418 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715881    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715885    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715897    4418 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715901    4418 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715906    4418 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715910    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715914    4418 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715918    4418 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715923    4418 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715927    4418 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715931    4418 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715935    4418 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715939    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 05:55:12.739815 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715944    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715948    4418 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715952    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715956    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715960    4418 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715964    4418 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715968    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715973    4418 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715977    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715981    4418 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715986    4418 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715990    4418 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715994    4418 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.715998    4418 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716002    4418 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716006    4418 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716011    4418 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716015    4418 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716019    4418 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716023    4418 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 05:55:12.740292 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716027    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716031    4418 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716043    4418 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716047    4418 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716052    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716056    4418 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716062    4418 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716066    4418 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716071    4418 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716078    4418 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716083    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716088    4418 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716092    4418 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716097    4418 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716101    4418 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716106    4418 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716110    4418 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716114    4418 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716118    4418 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 05:55:12.740780 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716123    4418 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716127    4418 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716131    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716136    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716141    4418 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716145    4418 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716149    4418 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716153    4418 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716157    4418 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716161    4418 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716167    4418 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716171    4418 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716176    4418 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:12.716180    4418 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.716251    4418 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.717824    4418 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.717892    4418 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.718165    4418 server.go:1014] "Starting client certificate rotation"
Nov 03 05:55:12.741368 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.718299    4418 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.718346    4418 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 05:49:32 +0000 UTC" deadline="2028-06-06 05:08:19.816287766 +0000 UTC"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.718373    4418 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13943h13m7.097916539s"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.718925    4418 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.720769    4418 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.722275    4418 log.go:25] "Validated CRI v1 runtime API"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.723878    4418 log.go:25] "Validated CRI v1 image API"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.724618    4418 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 05:55:12.742123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.726011    4418 fs.go:135] Filesystem UUIDs: map[3e74a532-a85b-4bb9-9aba-47cc0c619769:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f4cefb93-28b7-45bd-80d4-41371bce98a2:/dev/nvme0n1p3]
Nov 03 05:55:12.741536 ip-10-0-138-242 systemd[1]: Started Kubernetes Kubelet.
Nov 03 05:55:12.742643 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.726028    4418 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/05dc2ead3b00f7d111a0a4383fd80b58a55248301aaf312d41faaf67f13e255e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/05dc2ead3b00f7d111a0a4383fd80b58a55248301aaf312d41faaf67f13e255e/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1acb5cc9c10eec372edd0e218211d54aacea9f5ef62bdd8b1aed9b33c43ac1c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1acb5cc9c10eec372edd0e218211d54aacea9f5ef62bdd8b1aed9b33c43ac1c0/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1d564d3700cf5531f75d449f7abcc877e229c8a03c13fc800fcccb3574c01af4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1d564d3700cf5531f75d449f7abcc877e229c8a03c13fc800fcccb3574c01af4/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5a3832a04a9d6b5593417b31f1ce8d77ae4ccf0c78c2a850657cd489b92ff3ce/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5a3832a04a9d6b5593417b31f1ce8d77ae4ccf0c78c2a850657cd489b92ff3ce/userdata/shm major:0 minor:97 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5bc345cc8bfa45c624c845f8fcc953f9a35ee01cdb8c2e616de2d7da5dbf21c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5bc345cc8bfa45c624c845f8fcc953f9a35ee01cdb8c2e616de2d7da5dbf21c0/userdata/shm major:0 minor:85 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/644ac139208fd18278b752cdd3010279aa720c02a66a2cc9bb3bdb1beb96745b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/644ac139208fd18278b752cdd3010279aa720c02a66a2cc9bb3bdb1beb96745b/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/89cc75951f10a06dad2767951bacd6324d9bebb7fbd7b9cc21505cdb53d3c9bc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/89cc75951f10a06dad2767951bacd6324d9bebb7fbd7b9cc21505cdb53d3c9bc/userdata/shm major:0 minor:81 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/978f03068abb7e0a5a446fd30dfb34a9ae53e5531b269cd7c2cb160e87655702/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/978f03068abb7e0a5a446fd30dfb34a9ae53e5531b269cd7c2cb160e87655702/userdata/shm major:0 minor:105 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9aa4a5a2929ad1d32b6766ba7727ddc24416cfe5b42a83ddaa2d32bb4cf50529/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9aa4a5a2929ad1d32b6766ba7727ddc24416cfe5b42a83ddaa2d32bb4cf50529/userdata/shm major:0 minor:101 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b884b90e6e49c59b330517b5d8407bf6107a37ace592ca3d322f799d0fdb5fe1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b884b90e6e49c59b330517b5d8407bf6107a37ace592ca3d322f799d0fdb5fe1/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f2bfb1fbc8807142b2da8b59f3a12591e16be7ee5966636a4551e080c6ed01ae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f2bfb1fbc8807142b2da8b59f3a12591e16be7ee5966636a4551e080c6ed01ae/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff865fe27b055b0d71c7dbaf9abd581d59fcc977f53977821ceaea7176a6af96/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff865fe27b055b0d71c7dbaf9abd581d59fcc977f53977821ceaea7176a6af96/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/180ebbd8-f149-4418-b609-572389c6d617/volumes/kubernetes.io~projected/kube-api-access-2t58q:{mountpoint:/var/lib/kubelet/pods/180ebbd8-f149-4418-b609-572389c6d617/volumes/kubernetes.io~projected/kube-api-access-2t58q major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~empty-dir/tmp major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~projected/kube-api-access-f45ll:{mountpoint:/var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~projected/kube-api-access-f45ll major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/44da4b70-4f4c-4cdf-8be7-684f68743c76/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/44da4b70-4f4c-4cdf-8be7-684f68743c76/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c654a48-02bf-4015-85e1-be3bf1ef9b12/volumes/kubernetes.io~projected/kube-api-access-smfrs:{mountpoint:/var/lib/kubelet/pods/4c654a48-02bf-4015-85e1-be3bf1ef9b12/volumes/kubernetes.io~projected/kube-api-access-smfrs major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/759c2efb-9378-426a-9f2b-2ee9179c84ca/volumes/kubernetes.io~projected/kube-api-access-pp6km:{mountpoint:/var/lib/kubelet/pods/759c2efb-9378-426a-9f2b-2ee9179c84ca/volumes/kubernetes.io~projected/kube-api-access-pp6km major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a/volumes/kubernetes.io~projected/kube-api-access-vwczz:{mountpoint:/var/lib/kubelet/pods/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a/volumes/kubernetes.io~projected/kube-api-access-vwczz major:0 minor:68 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4/volumes/kubernetes.io~projected/kube-api-access-7wtrk:{mountpoint:/var/lib/kubelet/pods/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4/volumes/kubernetes.io~projected/kube-api-access-7wtrk major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volumes/kubernetes.io~projected/kube-api-access-s44kq:{mountpoint:/var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volumes/kubernetes.io~projected/kube-api-access-s44kq major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a25e9f30-3ae1-4319-a77a-708295d60f0f/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/a25e9f30-3ae1-4319-a77a-708295d60f0f/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b679ae94-3889-42b9-92f5-41793768bd69/volumes/kubernetes.io~projected/kube-api-access-ccthw:{mountpoint:/var/lib/kubelet/pods/b679ae94-3889-42b9-92f5-41793768bd69/volumes/kubernetes.io~projected/kube-api-access-ccthw major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6083fc7-5b1c-42f1-831e-9a95857c0720/volumes/kubernetes.io~projected/kube-api-access-xlr7x:{mountpoint:/var/lib/kubelet/pods/c6083fc7-5b1c-42f1-831e-9a95857c0720/volumes/kubernetes.io~projected/kube-api-access-xlr7x major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cad68c47-f589-44b7-831f-05e4d74ad98d/volumes/kubernetes.io~projected/kube-api-access-4kp4v:{mountpoint:/var/lib/kubelet/pods/cad68c47-f589-44b7-831f-05e4d74ad98d/volumes/kubernetes.io~projected/kube-api-access-4kp4v major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e0832f8b-30ec-40dd-bcdb-cddc19fd657d/volumes/kubernetes.io~projected/kube-api-access-ghmcm:{mountpoint:/var/lib/kubelet/pods/e0832f8b-30ec-40dd-bcdb-cddc19fd657d/volumes/kubernetes.io~projected/kube-api-access-ghmcm major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4e3fb98-d6df-4769-8ee4-53219b93176e/volumes/kubernetes.io~projected/kube-api-access-zfmrr:{mountpoint:/var/lib/kubelet/pods/e4e3fb98-d6df-4769-8ee4-53219b93176e/volumes/kubernetes.io~projected/kube-api-access-zfmrr major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5c60201-2d6d-4914-950f-632901f554a3/volumes/kubernetes.io~projected/kube-api-access-x5kdz:{mountpoint:/var/lib/kubelet/pods/e5c60201-2d6d-4914-950f-632901f554a3/volumes/kubernetes.io~projected/kube-api-access-x5kdz major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5c60201-2d6d-4914-950f-632901f554a3/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/e5c60201-2d6d-4914-950f-632901f554a3/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc6f8642-bdd0-42b6-a018-98a1642752cc/volumes/kubernetes.io~projected/kube-api-access-rwf6w:{mountpoint:/var/lib/kubelet/pods/fc6f8642-bdd0-42b6-a018-98a1642752cc/volumes/kubernetes.io~projected/kube-api-access-rwf6w major:0 minor:69 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-103:{mountpoint:/var/lib/containers/storage/overlay/cb35917f111eba8a62a33ba82ea9d5431bdc7411627c57f274efb3f44e94d4d8/merged major:0 minor:103 fsType:overlay blockSize:0} overlay_0-107:{mountpoint:/var/lib/containers/storage/overlay/7bbd58f67cac4588fef41812afcbe466a67d2ca76d06ceb4411273caabc00538/merged major:0 minor:107 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/90916ef20d4f4022de18d0feb6ef26cb32c9b9b7e6778161eb12f96011217b26/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/45acaf1cbdd526384444c6bce8073c5e346f4b69b0567c0ad4fb09915bc55365/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/9fec3ceed272b72629319f49bd0a2f13f902a62e08a7414038b892b259a1359e/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/d768476ac1529da14b6d9894b41aca458a85e27d79cefd1c842d01ec20aac166/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/a4fd42bf7808eba66dcddb18b74107609942a568d3db92505501dbacb9a4cf0c/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/83625a68b84d5c4ee167c3018eee26548fa375dc27f032c902b0f2604b060516/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/b432e36a455f5b36ae3a22c377184e1bdce2edc917ed8b5ea87951ea03cc1a56/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/9ecdfe682c5243ec3d1587c95f1655eaccead96a7d2c359c04381d0943184036/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/8802f9349134c695eafaafc3fa72d90a13ff6ac602ced4f741a22bdf55d8a643/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/d1b05da412703a3477fc2dabf8e54877bcea15382802605fd5d38f796092b065/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/620b8b4c135963c0b31d490e2e845a0669b8db5d0bccb9d969ee8b09c9b56102/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/5be07640d6fa351df903f1f33f5e2ccb254d5046efee318e79fedc5a519fab01/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/b5b7a67e9904db6c3cf998c8dbb92017240d8b67e7c4b9e8edf39c97d039f7d7/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/145c37a5f4d349fe60d9c589fe9ad84106a675e50d126850ef7e5acfcdc8a09e/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/148bcda83703f6f1b072c712f39fe0161ef4b9cd5e6930aad51350591b587548/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/ec2257f9fbee607aa08c577be4ae90676d3863fef36f94b10f0ca5bf9cdef468/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/08efc19373a7b3738bf6319c426aed004fc57a42e2ed6ff97843a3af5572bfff/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/ed8c2e0065e62fa2fea271b5769120a83e05321d201063a60e877cd3821899c5/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/e41742beec14d4d6dc68803e8f927c1e94728aa6960cdc3036cbb8093e9942ea/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/f2ce8945e11988d6c8ed7f5aa09270ea89342cfa5a830ae2b42df7c99f776d50/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/b3e81685665b33995a5f3a422df13e2ad89f44c294042cd49f637b5a69470f03/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/59da70806c45a4ba42fe9f231028a2551026eb2049fde4bf5f6133668b38f5ff/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/962af8e11c21a150d857ce82a1fad41ffcf2f9097acae7ef79b1edec6b08bf4c/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/eeb7399bbbeb002cadbb58536ee2d93424d756430d580d057254f263b49f434a/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/4050286ee21bf39cfdb60cc71af2b7071c6990b829dd24efa56c48c9d3656a01/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/30ec927db24a2d21f3ea555f21abde856af05736e0eb792d41bfe16377072790/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/d13097f0b274b9b1eb54a07088058681f7adf2f67619870f364d828745f469be/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/51958f86e1ed84e4bd9cc702d82a9887603e52f4548d4c37f581f269c095466a/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-55:{mountpoint:/var/lib/containers/storage/overlay/dfe4b66524619fb55416eee6446e5c7be571ef3ca5ab6cdae27e7e2f84286379/merged major:0 minor:55 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/a3e1dd4080176746aef7aa1158830b6be3650d07a177e7cf28d5bd7a7ee31255/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/dbff7216a7eb9b195ae6d49ccb5d6b1154b1028879a8b63778c8786247409175/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-79:{mountpoint:/var/lib/containers/storage/overlay/c1636ab90f1168444495659c5f6b479ba75045fcf0f3cc57b7eaaf444c1853b1/merged major:0 minor:79 fsType:overlay blockSize:0} overlay_0-83:{mountpoint:/var/lib/containers/storage/overlay/01bcd6c90d24a13c9672a2b313ace6c60dcf24dd88dc26dca5646586790b866f/merged major:0 minor:83 fsType:overlay blockSize:0} overlay_0-87:{mountpoint:/var/lib/containers/storage/overlay/8e1bb69f3ba8afdf592b65c4d2dd81e5f632ea0ffe2a70e295b15c0c16de1368/merged major:0 minor:87 fsType:overlay blockSize:0} overlay_0-91:{mountpoint:/var/lib/containers/storage/overlay/7a8c9340d16de72eb7ce2145f7c58911f4edb8b33cb4892634a73deda44ff14d/merged major:0 minor:91 fsType:overlay blockSize:0} overlay_0-95:{mountpoint:/var/lib/containers/storage/overlay/ddbdd0dee30d8fa3ca84825c313e0b69ed8e48293f3558e047f9e761d504dcd5/merged major:0 minor:95 fsType:overlay blockSize:0} overlay_0-99:{mountpoint:/var/lib/containers/storage/overlay/08a8191bb8146f7ba358457d0d6216c568c997b5718a9add11c4dfe28773ece3/merged major:0 minor:99 fsType:overlay blockSize:0}]
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732178    4418 manager.go:217] Machine: {Timestamp:2026-11-03 05:55:12.731740042 +0000 UTC m=+0.101690117 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100276 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2322f0ec1d6646c3bbc870d804ced3 SystemUUID:ec2322f0-ec1d-6646-c3bb-c870d804ced3 BootID:15c0db89-ca27-4449-80b0-5825a48a3188 Filesystems:[{Device:/run/containers/storage/overlay-containers/9aa4a5a2929ad1d32b6766ba7727ddc24416cfe5b42a83ddaa2d32bb4cf50529/userdata/shm DeviceMajor:0 DeviceMinor:101 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/05dc2ead3b00f7d111a0a4383fd80b58a55248301aaf312d41faaf67f13e255e/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a25e9f30-3ae1-4319-a77a-708295d60f0f/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/978f03068abb7e0a5a446fd30dfb34a9ae53e5531b269cd7c2cb160e87655702/userdata/shm DeviceMajor:0 DeviceMinor:105 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-79 DeviceMajor:0 DeviceMinor:79 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/44da4b70-4f4c-4cdf-8be7-684f68743c76/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:208 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c6083fc7-5b1c-42f1-831e-9a95857c0720/volumes/kubernetes.io~projected/kube-api-access-xlr7x DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/89cc75951f10a06dad2767951bacd6324d9bebb7fbd7b9cc21505cdb53d3c9bc/userdata/shm DeviceMajor:0 DeviceMinor:81 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5a3832a04a9d6b5593417b31f1ce8d77ae4ccf0c78c2a850657cd489b92ff3ce/userdata/shm DeviceMajor:0 DeviceMinor:97 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4/volumes/kubernetes.io~projected/kube-api-access-7wtrk DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff865fe27b055b0d71c7dbaf9abd581d59fcc977f53977821ceaea7176a6af96/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/644ac139208fd18278b752cdd3010279aa720c02a66a2cc9bb3bdb1beb96745b/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~projected/kube-api-access-f45ll DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/759c2efb-9378-426a-9f2b-2ee9179c84ca/volumes/kubernetes.io~projected/kube-api-access-pp6km DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/fc6f8642-bdd0-42b6-a018-98a1642752cc/volumes/kubernetes.io~projected/kube-api-access-rwf6w DeviceMajor:0 DeviceMinor:69 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-83 DeviceMajor:0 DeviceMinor:83 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-103 DeviceMajor:0 DeviceMinor:103 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1d206e49-6bf6-4139-8e0f-02e7840cec50/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e4e3fb98-d6df-4769-8ee4-53219b93176e/volumes/kubernetes.io~projected/kube-api-access-zfmrr DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5bc345cc8bfa45c624c845f8fcc953f9a35ee01cdb8c2e616de2d7da5dbf21c0/userdata/shm DeviceMajor:0 DeviceMinor:85 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f2bfb1fbc8807142b2da8b59f3a12591e16be7ee5966636a4551e080c6ed01ae/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-55 DeviceMajor:0 DeviceMinor:55 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-107 DeviceMajor:0 DeviceMinor:107 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b884b90e6e49c59b330517b5d8407bf6107a37ace592ca3d322f799d0fdb5fe1/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volumes/kubernetes.io~projected/kube-api-access-s44kq DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-87 DeviceMajor:0 DeviceMinor:87 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e0832f8b-30ec-40dd-bcdb-cddc19fd657d/volumes/kubernetes.io~projected/kube-api-access-ghmcm DeviceMajor:0 DeviceMinor:223 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e5c60201-2d6d-4914-950f-632901f554a3/volumes/kubernetes.io~projected/kube-api-access-x5kdz DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a/volumes/kubernetes.io~projected/kube-api-access-vwczz DeviceMajor:0 DeviceMinor:68 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e5c60201-2d6d-4914-950f-632901f554a3/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-99 DeviceMajor:0 DeviceMinor:99 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/801a6f81-0e55-40e6-8740-2ab8bcf0cad8/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/180ebbd8-f149-4418-b609-572389c6d617/volumes/kubernetes.io~projected/kube-api-access-2t58q DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4c654a48-02bf-4015-85e1-be3bf1ef9b12/volumes/kubernetes.io~projected/kube-api-access-smfrs DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b679ae94-3889-42b9-92f5-41793768bd69/volumes/kubernetes.io~projected/kube-api-access-ccthw DeviceMajor:0 DeviceMinor:213 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cad68c47-f589-44b7-831f-05e4d74ad98d/volumes/kubernetes.io~projected/kube-api-access-4kp4v DeviceMajor:0 DeviceMinor:222 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1acb5cc9c10eec372edd0e218211d54aacea9f5ef62bdd8b1aed9b33c43ac1c0/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1d564d3700cf5531f75d449f7abcc877e229c8a03c13fc800fcccb3574c01af4/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-95 DeviceMajor:0 DeviceMinor:95 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-91 DeviceMajor:0 DeviceMinor:91 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:05dc2ead3b00f7d MacAddress:ce:46:98:d7:50:8f Speed:10000 Mtu:8901} {Name:1d564d3700cf553 MacAddress:d6:c3:af:cf:e8:b0 Speed:10000 Mtu:8901} {Name:644ac139208fd18 MacAddress:aa:66:83:d7:e5:4f Speed:10000 Mtu:8901} {Name:b884b90e6e49c59 MacAddress:3a:9a:a2:5d:29:d0 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:e0:ec:7c:17 Speed:0 Mtu:9001} {Name:br-int MacAddress:e6:d2:90:16:e3:e4 Speed:0 Mtu:8901} {Name:ens5 MacAddress:02:ff:e0:ec:7c:17 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:ce:64:0e:ec:ba:d1 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:b6:48:81:3a:3b:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732401    4418 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732439    4418 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732773    4418 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732797    4418 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732938    4418 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732946    4418 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732959    4418 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.732973    4418 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733055    4418 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733238    4418 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733351    4418 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733482    4418 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733528    4418 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733548    4418 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733570    4418 kubelet.go:405] "Adding apiserver pod source"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.733587    4418 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.734638    4418 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.734655    4418 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.735372    4418 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737388    4418 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737397    4418 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737482    4418 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737658    4418 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737684    4418 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737763    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737774    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737780    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737785    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737791    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737796    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737802    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737808    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737814    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737820    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737828    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737836    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737857    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.737862    4418 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.741017    4418 server.go:1263] "Started kubelet"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.741088    4418 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.741129    4418 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.741208    4418 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.741490    4418 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 05:55:12.742909 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.742342    4418 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.743887    4418 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.744105    4418 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.744174    4418 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 05:49:34 +0000 UTC" deadline="2028-04-03 08:24:23.536211058 +0000 UTC"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.744209    4418 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12410h29m10.792004909s"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.744369    4418 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.744391    4418 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.744463    4418 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 05:55:12.744962 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:12.744587    4418 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-242.ec2.internal\" not found"
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746391    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d206e49-6bf6-4139-8e0f-02e7840cec50" volumeName="kubernetes.io/projected/1d206e49-6bf6-4139-8e0f-02e7840cec50-kube-api-access-f45ll" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746430    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c654a48-02bf-4015-85e1-be3bf1ef9b12" volumeName="kubernetes.io/projected/4c654a48-02bf-4015-85e1-be3bf1ef9b12-kube-api-access-smfrs" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746442    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c1a66d3-b7e0-4e4d-beb0-f64d3212543a" volumeName="kubernetes.io/empty-dir/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-tmp-dir" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746454    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c1a66d3-b7e0-4e4d-beb0-f64d3212543a" volumeName="kubernetes.io/projected/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-kube-api-access-vwczz" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746463    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4" volumeName="kubernetes.io/empty-dir/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-tmp-dir" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746471    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5c60201-2d6d-4914-950f-632901f554a3" volumeName="kubernetes.io/projected/e5c60201-2d6d-4914-950f-632901f554a3-kube-api-access-x5kdz" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746486    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5c60201-2d6d-4914-950f-632901f554a3" volumeName="kubernetes.io/secret/e5c60201-2d6d-4914-950f-632901f554a3-cert" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746512    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc6f8642-bdd0-42b6-a018-98a1642752cc" volumeName="kubernetes.io/projected/fc6f8642-bdd0-42b6-a018-98a1642752cc-kube-api-access-rwf6w" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746529    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c654a48-02bf-4015-85e1-be3bf1ef9b12" volumeName="kubernetes.io/configmap/4c654a48-02bf-4015-85e1-be3bf1ef9b12-iptables-alerter-script" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746537    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c2efb-9378-426a-9f2b-2ee9179c84ca" volumeName="kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-binary-copy" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746548    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="801a6f81-0e55-40e6-8740-2ab8bcf0cad8" volumeName="kubernetes.io/secret/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746556    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6083fc7-5b1c-42f1-831e-9a95857c0720" volumeName="kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-daemon-config" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746574    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6083fc7-5b1c-42f1-831e-9a95857c0720" volumeName="kubernetes.io/projected/c6083fc7-5b1c-42f1-831e-9a95857c0720-kube-api-access-xlr7x" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746592    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c2efb-9378-426a-9f2b-2ee9179c84ca" volumeName="kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 03 05:55:12.746777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746604    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25e9f30-3ae1-4319-a77a-708295d60f0f" volumeName="kubernetes.io/configmap/a25e9f30-3ae1-4319-a77a-708295d60f0f-konnectivity-ca" seLinuxMountContext=""
Nov 03 05:55:12.747578 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.747413    4418 factory.go:55] Registering systemd factory
Nov 03 05:55:12.747578 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.747430    4418 factory.go:223] Registration of the systemd container factory successfully
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.746614    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b679ae94-3889-42b9-92f5-41793768bd69" volumeName="kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.749849    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="180ebbd8-f149-4418-b609-572389c6d617" volumeName="kubernetes.io/configmap/180ebbd8-f149-4418-b609-572389c6d617-serviceca" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.749873    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="44da4b70-4f4c-4cdf-8be7-684f68743c76" volumeName="kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.749896    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4" volumeName="kubernetes.io/configmap/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-config-volume" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.749913    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="801a6f81-0e55-40e6-8740-2ab8bcf0cad8" volumeName="kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-env-overrides" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.749927    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a25e9f30-3ae1-4319-a77a-708295d60f0f" volumeName="kubernetes.io/secret/a25e9f30-3ae1-4319-a77a-708295d60f0f-agent-certs" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.749945    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cad68c47-f589-44b7-831f-05e4d74ad98d" volumeName="kubernetes.io/empty-dir/cad68c47-f589-44b7-831f-05e4d74ad98d-data-volume" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.749981    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d206e49-6bf6-4139-8e0f-02e7840cec50" volumeName="kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-tmp" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750002    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c2efb-9378-426a-9f2b-2ee9179c84ca" volumeName="kubernetes.io/projected/759c2efb-9378-426a-9f2b-2ee9179c84ca-kube-api-access-pp6km" seLinuxMountContext=""
Nov 03 05:55:12.750061 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750016    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="801a6f81-0e55-40e6-8740-2ab8bcf0cad8" volumeName="kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-script-lib" seLinuxMountContext=""
Nov 03 05:55:12.750737 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750058    4418 factory.go:153] Registering CRI-O factory
Nov 03 05:55:12.750737 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750196    4418 factory.go:223] Registration of the crio container factory successfully
Nov 03 05:55:12.750737 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750262    4418 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 05:55:12.750737 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750283    4418 factory.go:103] Registering Raw factory
Nov 03 05:55:12.750737 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750300    4418 manager.go:1199] Started watching for new ooms in manager
Nov 03 05:55:12.750737 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750630    4418 manager.go:319] Starting recovery of all containers
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.750034    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6083fc7-5b1c-42f1-831e-9a95857c0720" volumeName="kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-cni-binary-copy" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751063    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="180ebbd8-f149-4418-b609-572389c6d617" volumeName="kubernetes.io/projected/180ebbd8-f149-4418-b609-572389c6d617-kube-api-access-2t58q" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751086    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1d206e49-6bf6-4139-8e0f-02e7840cec50" volumeName="kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-tuned" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751117    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4" volumeName="kubernetes.io/projected/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-kube-api-access-7wtrk" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751130    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cad68c47-f589-44b7-831f-05e4d74ad98d" volumeName="kubernetes.io/projected/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-api-access-4kp4v" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751148    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0832f8b-30ec-40dd-bcdb-cddc19fd657d" volumeName="kubernetes.io/projected/e0832f8b-30ec-40dd-bcdb-cddc19fd657d-kube-api-access-ghmcm" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751161    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4e3fb98-d6df-4769-8ee4-53219b93176e" volumeName="kubernetes.io/projected/e4e3fb98-d6df-4769-8ee4-53219b93176e-kube-api-access-zfmrr" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751177    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="759c2efb-9378-426a-9f2b-2ee9179c84ca" volumeName="kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751190    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="801a6f81-0e55-40e6-8740-2ab8bcf0cad8" volumeName="kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-config" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751202    4418 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="801a6f81-0e55-40e6-8740-2ab8bcf0cad8" volumeName="kubernetes.io/projected/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-kube-api-access-s44kq" seLinuxMountContext=""
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751213    4418 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 05:55:12.751530 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.751220    4418 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 05:55:12.774304 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.774250    4418 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 05:55:12.775549 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.775528    4418 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 05:55:12.775549 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.775546    4418 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 05:55:12.775689 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.775566    4418 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 05:55:12.775689 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:12.775610    4418 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 03 05:55:12.784195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.784170    4418 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:55:12.786171 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.786137    4418 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="f3798052eefbf542832cc0aae7a1d306dedf72572a7b06b069d15fcc0029e108" exitCode=0
Nov 03 05:55:12.786171 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.786170    4418 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="4e30159ea58911fe8e8dec948cf76ae46680e032ab85754dc4fdaba3d7fb30dd" exitCode=0
Nov 03 05:55:12.786326 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.786177    4418 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="31358dfefdc0484d40c19c991a260560592e0c5b26dcf2f363bb0f6874bf9707" exitCode=0
Nov 03 05:55:12.786326 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.786183    4418 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="49b8272944ceb8831cac2d531abcf96ff36c4bf3df2f0ec29226e0a3d47a9663" exitCode=0
Nov 03 05:55:12.786326 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.786189    4418 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="66c423bf3227653ead21bf1fa023a10ee7285db0f1774c19b5e0d8ca1db18928" exitCode=0
Nov 03 05:55:12.786326 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.786194    4418 generic.go:356] "Generic (PLEG): container finished" podID="759c2efb-9378-426a-9f2b-2ee9179c84ca" containerID="824e42f37ef9ae112a3f143475f6664c7d6fdf1ea59282ab601af686fafa452c" exitCode=0
Nov 03 05:55:12.795130 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.795113    4418 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 03 05:55:12.796350 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.796326    4418 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:55:12.807382 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.807347    4418 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:55:12.809296 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.809223    4418 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 05:55:12.809904 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.809849    4418 generic.go:356] "Generic (PLEG): container finished" podID="3cadd07d0bc5cca312fe70e95ea81342" containerID="74d382ed8350f2dd20d38b1187bb36126a743a9cd9ae58a79a3e6609ecfc1b5b" exitCode=0
Nov 03 05:55:12.817300 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.817286    4418 manager.go:324] Recovery completed
Nov 03 05:55:12.830113 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830093    4418 cpu_manager.go:226] "Starting" policy="none"
Nov 03 05:55:12.830113 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830105    4418 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 05:55:12.830251 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830121    4418 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 05:55:12.830302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830247    4418 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 03 05:55:12.830302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830261    4418 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 03 05:55:12.830302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830275    4418 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 03 05:55:12.830302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830280    4418 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 03 05:55:12.830302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830285    4418 policy_none.go:50] "Start"
Nov 03 05:55:12.830302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830293    4418 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 05:55:12.830302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830301    4418 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 05:55:12.830541 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830415    4418 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 03 05:55:12.830541 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830422    4418 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 03 05:55:12.830541 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.830427    4418 policy_none.go:44] "Start"
Nov 03 05:55:12.834214 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.834192    4418 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 05:55:12.836860 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.836847    4418 manager.go:341] "Starting Device Plugin manager"
Nov 03 05:55:12.837582 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:12.836871    4418 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 05:55:12.837672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.837589    4418 server.go:87] "Starting device plugin registration server"
Nov 03 05:55:12.837976 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.837961    4418 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 05:55:12.838028 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.837979    4418 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 05:55:12.838523 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.838491    4418 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 05:55:12.838654 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.838620    4418 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 05:55:12.838710 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.838664    4418 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 05:55:12.838710 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.838671    4418 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 05:55:12.838839 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.838750    4418 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T05:55:12.838653905Z","UUID":"28149eec-dc40-4b24-b0b1-b0c25c0ad0aa","Handler":null,"Name":"","Endpoint":""}
Nov 03 05:55:12.840449 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.840424    4418 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 05:55:12.840598 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.840458    4418 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 05:55:12.840598 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:12.840428    4418 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 05:55:12.876325 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.876280    4418 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"]
Nov 03 05:55:12.876768 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.876742    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal" event={"ID":"64792e0a2fa5247cd6cb1dcb331e5e11","Type":"ContainerStarted","Data":"9d512a761e646b6a0be1b741f50adfffdfdf74740bfb291c9ebef8c0b9306f09"}
Nov 03 05:55:12.876811 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.876775    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal" event={"ID":"64792e0a2fa5247cd6cb1dcb331e5e11","Type":"ContainerStarted","Data":"7b8d6a4e4a4ee807b3a57490162f4d2f851e2b62ff8f81904808f590a821336e"}
Nov 03 05:55:12.876811 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.876799    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal" event={"ID":"3cadd07d0bc5cca312fe70e95ea81342","Type":"ContainerStarted","Data":"343c9d410fb5b5ab75bac5c0c3b5c2a657144f72e3bc69f360651ffe8ebd94ab"}
Nov 03 05:55:12.876884 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.876810    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal" event={"ID":"3cadd07d0bc5cca312fe70e95ea81342","Type":"ContainerDied","Data":"74d382ed8350f2dd20d38b1187bb36126a743a9cd9ae58a79a3e6609ecfc1b5b"}
Nov 03 05:55:12.876884 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.876824    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal" event={"ID":"3cadd07d0bc5cca312fe70e95ea81342","Type":"ContainerStarted","Data":"2933529da13681d8393caa2bbd7011e5b9bd3b26272709edf1035098176359f0"}
Nov 03 05:55:12.876884 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.876832    4418 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.877044 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.877029    4418 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.903680 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.903661    4418 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 05:55:12.903754 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:12.903706    4418 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-242.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.925576 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.925554    4418 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 05:55:12.925638 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:12.925592    4418 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.938676 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.938660    4418 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 05:55:12.939792 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.939777    4418 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 05:55:12.939864 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.939807    4418 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 05:55:12.939864 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.939822    4418 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-242.ec2.internal" event="NodeHasSufficientPID"
Nov 03 05:55:12.939864 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.939860    4418 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.977591 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.977568    4418 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.977670 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.977621    4418 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.996194 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.996171    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.996271 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.996208    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:12.996271 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:12.996225    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64792e0a2fa5247cd6cb1dcb331e5e11-config\") pod \"kube-apiserver-proxy-ip-10-0-138-242.ec2.internal\" (UID: \"64792e0a2fa5247cd6cb1dcb331e5e11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.096642 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.096566    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.096642 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.096597    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64792e0a2fa5247cd6cb1dcb331e5e11-config\") pod \"kube-apiserver-proxy-ip-10-0-138-242.ec2.internal\" (UID: \"64792e0a2fa5247cd6cb1dcb331e5e11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.096642 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.096617    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.096841 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.096668    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64792e0a2fa5247cd6cb1dcb331e5e11-config\") pod \"kube-apiserver-proxy-ip-10-0-138-242.ec2.internal\" (UID: \"64792e0a2fa5247cd6cb1dcb331e5e11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.096841 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.096683    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.096841 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.096731    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cadd07d0bc5cca312fe70e95ea81342-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" (UID: \"3cadd07d0bc5cca312fe70e95ea81342\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.734590 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.734553    4418 apiserver.go:52] "Watching apiserver"
Nov 03 05:55:13.779456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.779430    4418 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 05:55:13.779810 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.779792    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7zjvt","openshift-ovn-kubernetes/ovnkube-node-gk8rt","openshift-multus/network-metrics-daemon-42ps6","kube-system/konnectivity-agent-hcd9r","openshift-cluster-node-tuning-operator/tuned-zgzqf","kube-system/kube-apiserver-proxy-ip-10-0-138-242.ec2.internal","openshift-image-registry/node-ca-zn76c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal","openshift-insights/insights-runtime-extractor-dwm99","openshift-dns/node-resolver-hjb7w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98","openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g","openshift-multus/multus-additional-cni-plugins-7fb9t","openshift-network-diagnostics/network-check-target-8669x","kube-system/global-pull-secret-syncer-t477r","openshift-ingress-canary/ingress-canary-clgrr","openshift-multus/multus-tfmns","openshift-network-operator/iptables-alerter-2h7wj"]
Nov 03 05:55:13.780791 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.780771    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:13.783827 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.783806    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.784574 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.784559    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.795212 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.795196    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 05:55:13.795212 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.795203    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.795338 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.795326    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.795433 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.795422    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 05:55:13.795468 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.795455    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.795581 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.795570    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z796t\""
Nov 03 05:55:13.795627 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.795603    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-zq86f\""
Nov 03 05:55:13.807685 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.807670    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.807738 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.807686    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.807738 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.807726    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.807812 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.807737    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 05:55:13.807812 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.807745    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 05:55:13.807812 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.807763    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.807812 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.807793    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mlps4\""
Nov 03 05:55:13.810050 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810039    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.810160 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810149    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.810219 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810205    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 05:55:13.810257 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810205    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.810635 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810622    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.810857 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810847    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.810957 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810939    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.811015 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.810982    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.811057 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811013    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.811159 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811142    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.811159 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811155    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.811255 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811174    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 05:55:13.811255 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811190    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.811255 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811205    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.811255 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811213    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 05:55:13.811255 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811215    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.811255 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811244    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 05:55:13.811415 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811244    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 05:55:13.811415 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811267    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 05:55:13.811415 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811349    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 05:55:13.811569 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.811548    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 05:55:13.812143 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.812131    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 05:55:13.816284 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.816267    4418 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.846107 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.846071    4418 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 05:55:13.847382 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.847363    4418 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 05:55:13.847447 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:13.847411    4418 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-242.ec2.internal"
Nov 03 05:55:13.899768 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.899728    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 05:55:13.899867 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.899823    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 05:55:13.900065 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900052    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-xj6m8\""
Nov 03 05:55:13.900146 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900130    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-conf\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.900211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900157    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-system-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.900211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900157    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 05:55:13.900287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900219    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-k8s-cni-cncf-io\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.900287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900245    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-daemon-config\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.900287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900258    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nvbtr\""
Nov 03 05:55:13.900287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900262    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-log-socket\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900295    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900334    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-xvf66\""
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900371    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-bin\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900379    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jcdvc\""
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900389    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900413    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hwk29\""
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900415    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a25e9f30-3ae1-4319-a77a-708295d60f0f-konnectivity-ca\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900425    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-krwzb\""
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900437    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8hrbq\""
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900440    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-sys-fs\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.900475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900472    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nphqj\""
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900523    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-lib-modules\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900630    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-daemon-config\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900665    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-host\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900683    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-cnibin\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900699    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-socket-dir-parent\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900751    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s44kq\" (UniqueName: \"kubernetes.io/projected/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-kube-api-access-s44kq\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900789    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a25e9f30-3ae1-4319-a77a-708295d60f0f-konnectivity-ca\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900793    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad68c47-f589-44b7-831f-05e4d74ad98d-data-volume\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900821    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-sys\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900846    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-tmp\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900871    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900903    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-var-lib-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.900913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900912    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad68c47-f589-44b7-831f-05e4d74ad98d-data-volume\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900930    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-ovn\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900983    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900996    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rwdxr\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.900988    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-tmp\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901038    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901051    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901067    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901091    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-hostroot\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901129    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-systemd-units\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901153    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901172    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gfnmx\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901178    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901184    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901178    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-config\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901228    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j9vz5\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901308    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901324    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901323    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/180ebbd8-f149-4418-b609-572389c6d617-serviceca\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901338    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-75slc\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901367    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901391    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kdz\" (UniqueName: \"kubernetes.io/projected/e5c60201-2d6d-4914-950f-632901f554a3-kube-api-access-x5kdz\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901416    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fkxng\""
Nov 03 05:55:13.901418 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901418    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c654a48-02bf-4015-85e1-be3bf1ef9b12-iptables-alerter-script\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901451    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-config-volume\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901466    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-tmp-dir\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901417    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-config\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901523    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysconfig\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901543    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/180ebbd8-f149-4418-b609-572389c6d617-serviceca\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901550    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-tmp-dir\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901549    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-run\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901603    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-node-log\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901630    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901664    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f45ll\" (UniqueName: \"kubernetes.io/projected/1d206e49-6bf6-4139-8e0f-02e7840cec50-kube-api-access-f45ll\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901682    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c654a48-02bf-4015-85e1-be3bf1ef9b12-iptables-alerter-script\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901691    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-multus\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901686    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-config-volume\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901777    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-multus-certs\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901793    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-systemd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901816    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901831    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c60201-2d6d-4914-950f-632901f554a3-cert\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901855    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad68c47-f589-44b7-831f-05e4d74ad98d-crio-socket\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901918    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901935    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-netd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901960    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901975    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-socket-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.901991    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kp4v\" (UniqueName: \"kubernetes.io/projected/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-api-access-4kp4v\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902004    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c60201-2d6d-4914-950f-632901f554a3-cert\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902008    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-modprobe-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902024    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902060    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-netns\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902078    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-slash\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902093    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902107    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-var-lib-kubelet\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902123    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902149    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smfrs\" (UniqueName: \"kubernetes.io/projected/4c654a48-02bf-4015-85e1-be3bf1ef9b12-kube-api-access-smfrs\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902165    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfmrr\" (UniqueName: \"kubernetes.io/projected/e4e3fb98-d6df-4769-8ee4-53219b93176e-kube-api-access-zfmrr\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902179    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmcm\" (UniqueName: \"kubernetes.io/projected/e0832f8b-30ec-40dd-bcdb-cddc19fd657d-kube-api-access-ghmcm\") pod \"migrator-66df5d496b-4rp7g\" (UID: \"e0832f8b-30ec-40dd-bcdb-cddc19fd657d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902194    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-env-overrides\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902208    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-hosts-file\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902221    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-kubernetes\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902236    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-system-cni-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902251    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c654a48-02bf-4015-85e1-be3bf1ef9b12-host-slash\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902265    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-kubelet\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902279    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlr7x\" (UniqueName: \"kubernetes.io/projected/c6083fc7-5b1c-42f1-831e-9a95857c0720-kube-api-access-xlr7x\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902411    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-env-overrides\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902415    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-kubelet\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902451    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovn-node-metrics-cert\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902478    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-script-lib\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902522    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-tmp-dir\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902555    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180ebbd8-f149-4418-b609-572389c6d617-host\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902581    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-registration-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.902570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902605    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-systemd\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902680    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-tmp-dir\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902752    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovn-node-metrics-cert\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902793    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-ovnkube-script-lib\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902800    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-tuned\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902920    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-device-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902931    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-tuned\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902959    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.902982    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp6km\" (UniqueName: \"kubernetes.io/projected/759c2efb-9378-426a-9f2b-2ee9179c84ca-kube-api-access-pp6km\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903045    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wtrk\" (UniqueName: \"kubernetes.io/projected/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-kube-api-access-7wtrk\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903139    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-bin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903141    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903156    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-conf-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903227    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-netns\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903289    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-etc-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903340    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t58q\" (UniqueName: \"kubernetes.io/projected/180ebbd8-f149-4418-b609-572389c6d617-kube-api-access-2t58q\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903371    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a25e9f30-3ae1-4319-a77a-708295d60f0f-agent-certs\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903387    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwf6w\" (UniqueName: \"kubernetes.io/projected/fc6f8642-bdd0-42b6-a018-98a1642752cc-kube-api-access-rwf6w\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903409    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903439    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903534    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-cnibin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903604    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a25e9f30-3ae1-4319-a77a-708295d60f0f-agent-certs\") pod \"konnectivity-agent-hcd9r\" (UID: \"a25e9f30-3ae1-4319-a77a-708295d60f0f\") " pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903640    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903669    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-cni-binary-copy\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903687    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-etc-kubernetes\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903700    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/759c2efb-9378-426a-9f2b-2ee9179c84ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903725    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-kubelet-config\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903764    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-dbus\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903796    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwczz\" (UniqueName: \"kubernetes.io/projected/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-kube-api-access-vwczz\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:55:13.904188 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.903814    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6083fc7-5b1c-42f1-831e-9a95857c0720-cni-binary-copy\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.911324 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.911307    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44da4b70-4f4c-4cdf-8be7-684f68743c76-original-pull-secret\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:13.930977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.930957    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s44kq\" (UniqueName: \"kubernetes.io/projected/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-kube-api-access-s44kq\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:13.931332 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.931317    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f45ll\" (UniqueName: \"kubernetes.io/projected/1d206e49-6bf6-4139-8e0f-02e7840cec50-kube-api-access-f45ll\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:13.932330 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.932314    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmcm\" (UniqueName: \"kubernetes.io/projected/e0832f8b-30ec-40dd-bcdb-cddc19fd657d-kube-api-access-ghmcm\") pod \"migrator-66df5d496b-4rp7g\" (UID: \"e0832f8b-30ec-40dd-bcdb-cddc19fd657d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-4rp7g"
Nov 03 05:55:13.940484 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.940466    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kdz\" (UniqueName: \"kubernetes.io/projected/e5c60201-2d6d-4914-950f-632901f554a3-kube-api-access-x5kdz\") pod \"ingress-canary-clgrr\" (UID: \"e5c60201-2d6d-4914-950f-632901f554a3\") " pod="openshift-ingress-canary/ingress-canary-clgrr"
Nov 03 05:55:13.940637 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.940622    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wtrk\" (UniqueName: \"kubernetes.io/projected/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-kube-api-access-7wtrk\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:13.943126 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.943111    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t58q\" (UniqueName: \"kubernetes.io/projected/180ebbd8-f149-4418-b609-572389c6d617-kube-api-access-2t58q\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:55:13.946134 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.946117    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwf6w\" (UniqueName: \"kubernetes.io/projected/fc6f8642-bdd0-42b6-a018-98a1642752cc-kube-api-access-rwf6w\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:13.946254 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.946237    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlr7x\" (UniqueName: \"kubernetes.io/projected/c6083fc7-5b1c-42f1-831e-9a95857c0720-kube-api-access-xlr7x\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:13.946371 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.946357    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwczz\" (UniqueName: \"kubernetes.io/projected/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-kube-api-access-vwczz\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:55:13.947599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.947580    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfmrr\" (UniqueName: \"kubernetes.io/projected/e4e3fb98-d6df-4769-8ee4-53219b93176e-kube-api-access-zfmrr\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:13.949113 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.949097    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccthw\" (UniqueName: \"kubernetes.io/projected/b679ae94-3889-42b9-92f5-41793768bd69-kube-api-access-ccthw\") pod \"network-check-target-8669x\" (UID: \"b679ae94-3889-42b9-92f5-41793768bd69\") " pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:13.950443 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.950423    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smfrs\" (UniqueName: \"kubernetes.io/projected/4c654a48-02bf-4015-85e1-be3bf1ef9b12-kube-api-access-smfrs\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:55:13.953291 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.953274    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kp4v\" (UniqueName: \"kubernetes.io/projected/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-api-access-4kp4v\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:13.953693 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:13.953676    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp6km\" (UniqueName: \"kubernetes.io/projected/759c2efb-9378-426a-9f2b-2ee9179c84ca-kube-api-access-pp6km\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:14.004412 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004358    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-system-cni-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:14.004412 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004387    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c654a48-02bf-4015-85e1-be3bf1ef9b12-host-slash\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:55:14.004412 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004409    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-kubelet\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004447    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-kubelet\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004463    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-system-cni-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004470    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c654a48-02bf-4015-85e1-be3bf1ef9b12-host-slash\") pod \"iptables-alerter-2h7wj\" (UID: \"4c654a48-02bf-4015-85e1-be3bf1ef9b12\") " pod="openshift-network-operator/iptables-alerter-2h7wj"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004481    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180ebbd8-f149-4418-b609-572389c6d617-host\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004489    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-kubelet\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004520    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-registration-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004525    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-kubelet\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004547    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-systemd\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004550    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180ebbd8-f149-4418-b609-572389c6d617-host\") pod \"node-ca-zn76c\" (UID: \"180ebbd8-f149-4418-b609-572389c6d617\") " pod="openshift-image-registry/node-ca-zn76c"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004566    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-registration-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.004599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004595    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-device-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004612    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-bin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004625    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-systemd\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004631    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-conf-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004658    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-device-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004660    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-netns\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004695    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-conf-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004663    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-bin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004711    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-netns\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004703    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-etc-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004728    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-etc-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004751    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-cnibin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004776    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004803    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-cnibin\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004802    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-etc-kubernetes\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004826    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-kubelet-config\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004832    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-etc-kubernetes\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004841    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-dbus\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004862    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-conf\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004877    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-system-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004889    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-kubelet-config\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004892    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-k8s-cni-cncf-io\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004913    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-k8s-cni-cncf-io\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004926    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-log-socket\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004949    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-bin\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004962    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-system-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004974    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.004997    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44da4b70-4f4c-4cdf-8be7-684f68743c76-dbus\") pod \"global-pull-secret-syncer-t477r\" (UID: \"44da4b70-4f4c-4cdf-8be7-684f68743c76\") " pod="kube-system/global-pull-secret-syncer-t477r"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005002    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-sys-fs\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005008    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-bin\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005008    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-log-socket\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005031    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-lib-modules\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005043    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-sys-fs\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005050    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-host\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005050    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-conf\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005065    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-cnibin\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005085    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-socket-dir-parent\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005102    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-host\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005110    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-sys\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.005099 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005123    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-cnibin\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005125    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-lib-modules\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005130    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysctl-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005148    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-var-lib-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005159    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-socket-dir-parent\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005152    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-sys\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005174    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-ovn\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005187    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-var-lib-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005191    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005211    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005233    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-hostroot\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005247    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-ovn\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005256    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-systemd-units\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005300    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-systemd-units\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005308    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad68c47-f589-44b7-831f-05e4d74ad98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.005305    4418 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.005308    4418 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005364    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-hostroot\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.005400    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:14.505368505 +0000 UTC m=+1.875318583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005415    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005434    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysconfig\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005453    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-run\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.005470    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:14.505455531 +0000 UTC m=+1.875405605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005494    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-run\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005517    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-sysconfig\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005511    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-node-log\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005548    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005578    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-multus\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005542    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-node-log\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005593    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-multus-certs\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005519    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-openvswitch\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005617    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-systemd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005626    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-multus-certs\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005606    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005640    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-run-systemd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005637    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-var-lib-cni-multus\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005646    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005667    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad68c47-f589-44b7-831f-05e4d74ad98d-crio-socket\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005689    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005712    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-netd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005716    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-etc-selinux\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005723    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad68c47-f589-44b7-831f-05e4d74ad98d-crio-socket\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005736    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005771    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-cni-netd\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005771    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005783    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-socket-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.005797    4418 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005805    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-modprobe-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005819    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-socket-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.005848    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:55:14.505833522 +0000 UTC m=+1.875783597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : secret "metrics-daemon-secret" not found
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005821    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005861    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-multus-cni-dir\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005885    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-modprobe-d\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005887    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-netns\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005911    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-slash\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005937    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005960    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6083fc7-5b1c-42f1-831e-9a95857c0720-host-run-netns\") pod \"multus-tfmns\" (UID: \"c6083fc7-5b1c-42f1-831e-9a95857c0720\") " pod="openshift-multus/multus-tfmns"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005960    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-var-lib-kubelet\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005981    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.005984    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/801a6f81-0e55-40e6-8740-2ab8bcf0cad8-host-slash\") pod \"ovnkube-node-gk8rt\" (UID: \"801a6f81-0e55-40e6-8740-2ab8bcf0cad8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.006006    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-hosts-file\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.006016    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-var-lib-kubelet\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.006024    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-kubernetes\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.006004    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc6f8642-bdd0-42b6-a018-98a1642752cc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x9g98\" (UID: \"fc6f8642-bdd0-42b6-a018-98a1642752cc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x9g98"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.006046    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/759c2efb-9378-426a-9f2b-2ee9179c84ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7fb9t\" (UID: \"759c2efb-9378-426a-9f2b-2ee9179c84ca\") " pod="openshift-multus/multus-additional-cni-plugins-7fb9t"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.006053    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c1a66d3-b7e0-4e4d-beb0-f64d3212543a-hosts-file\") pod \"node-resolver-hjb7w\" (UID: \"7c1a66d3-b7e0-4e4d-beb0-f64d3212543a\") " pod="openshift-dns/node-resolver-hjb7w"
Nov 03 05:55:14.006481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.006063    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d206e49-6bf6-4139-8e0f-02e7840cec50-etc-kubernetes\") pod \"tuned-zgzqf\" (UID: \"1d206e49-6bf6-4139-8e0f-02e7840cec50\") " pod="openshift-cluster-node-tuning-operator/tuned-zgzqf"
Nov 03 05:55:14.509132 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.509094    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:14.509322 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.509154    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:14.509322 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.509172    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:14.509322 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.509259    4418 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:14.509322 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.509273    4418 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:14.509322 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.509321    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:15.509309334 +0000 UTC m=+2.879259396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:14.509322 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.509279    4418 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 05:55:14.509561 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.509341    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:15.509328659 +0000 UTC m=+2.879278721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:14.509561 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:14.509353    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:55:15.509347606 +0000 UTC m=+2.879297669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : secret "metrics-daemon-secret" not found
Nov 03 05:55:14.997955 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:14.997924    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:15.515839 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:15.515804    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:15.516026 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:15.515845    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:15.516026 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:15.515956    4418 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:15.516026 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:15.515975    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:15.516142 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:15.515965    4418 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:15.516142 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:15.516040    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls podName:cad68c47-f589-44b7-831f-05e4d74ad98d nodeName:}" failed. No retries permitted until 2026-11-03 05:55:17.516021869 +0000 UTC m=+4.885971936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwm99" (UID: "cad68c47-f589-44b7-831f-05e4d74ad98d") : secret "insights-runtime-extractor-tls" not found
Nov 03 05:55:15.516142 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:15.516075    4418 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 05:55:15.516142 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:15.516093    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:17.516077844 +0000 UTC m=+4.886027910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:15.516142 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:15.516130    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:55:17.516119881 +0000 UTC m=+4.886069968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : secret "metrics-daemon-secret" not found
Nov 03 05:55:15.705844 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:15.705820    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:15.773745 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:15.773636    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:15.819995 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:15.819971    4418 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 05:55:15.945339 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:15.945311    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:16.636601 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:16.636557    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:17.231610 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.231555    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:17.290555 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.290534    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:17.438303 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.438275    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:17.527458 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.527395    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:17.527458 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.527453    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:17.527665 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:17.527544    4418 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 05:55:17.527665 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.527573    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:17.527665 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:17.527666    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:55:21.527651192 +0000 UTC m=+8.897601269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : secret "metrics-daemon-secret" not found
Nov 03 05:55:17.527832 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:17.527676    4418 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 03 05:55:17.527832 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:17.527713    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls podName:7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4 nodeName:}" failed. No retries permitted until 2026-11-03 05:55:21.527702466 +0000 UTC m=+8.897652528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls") pod "dns-default-7zjvt" (UID: "7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4") : secret "dns-default-metrics-tls" not found
Nov 03 05:55:17.527939 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.527871    4418 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 05:55:17.529842 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.529823    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad68c47-f589-44b7-831f-05e4d74ad98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwm99\" (UID: \"cad68c47-f589-44b7-831f-05e4d74ad98d\") " pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:17.684809 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.684771    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwm99"
Nov 03 05:55:17.740972 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.740944    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gk8rt"
Nov 03 05:55:17.831385 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.831297    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:17.989280 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:17.989248    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwm99"]
Nov 03 05:55:17.992830 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:17.992796    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad68c47_f589_44b7_831f_05e4d74ad98d.slice/crio-c1ce29c98f071760a8dbcabfa8e2d8561a4f8d37d8f1bf3322b27793b50ead69 WatchSource:0}: Error finding container c1ce29c98f071760a8dbcabfa8e2d8561a4f8d37d8f1bf3322b27793b50ead69: Status 404 returned error can't find the container with id c1ce29c98f071760a8dbcabfa8e2d8561a4f8d37d8f1bf3322b27793b50ead69
Nov 03 05:55:18.032163 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:18.032133    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:18.049232 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:18.049214    4418 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 05:55:18.436010 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:18.435979    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:18.827682 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:18.827612    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwm99" event={"ID":"cad68c47-f589-44b7-831f-05e4d74ad98d","Type":"ContainerStarted","Data":"6933c5eb77e533643ab86fedc4627e22360f81a522cff67007691411d0ec7dd9"}
Nov 03 05:55:18.827682 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:18.827662    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwm99" event={"ID":"cad68c47-f589-44b7-831f-05e4d74ad98d","Type":"ContainerStarted","Data":"be364fc718b88b5eae4d28a035a11dc0d78c830ac59b02891a9060e045e59edc"}
Nov 03 05:55:18.827682 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:18.827681    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwm99" event={"ID":"cad68c47-f589-44b7-831f-05e4d74ad98d","Type":"ContainerStarted","Data":"c1ce29c98f071760a8dbcabfa8e2d8561a4f8d37d8f1bf3322b27793b50ead69"}
Nov 03 05:55:19.222602 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:19.222575    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hjb7w_7c1a66d3-b7e0-4e4d-beb0-f64d3212543a/dns-node-resolver/0.log"
Nov 03 05:55:19.227106 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:19.227082    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:19.623796 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:19.623766    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:19.831682 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:19.831653    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwm99" event={"ID":"cad68c47-f589-44b7-831f-05e4d74ad98d","Type":"ContainerStarted","Data":"438be81d28e4f697536e4f51e41b4e2bd37a924c20b1d2e035a680b8b57b86ca"}
Nov 03 05:55:19.832952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:19.832920    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:20.023133 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:20.023051    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:20.187428 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:20.187394    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:20.350084 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:20.350014    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:20.421676 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:20.421653    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zn76c_180ebbd8-f149-4418-b609-572389c6d617/node-ca/0.log"
Nov 03 05:55:20.524221 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:20.524193    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:21.022233 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.022204    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clgrr_e5c60201-2d6d-4914-950f-632901f554a3/serve-healthcheck-canary/0.log"
Nov 03 05:55:21.422451 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.422420    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-4rp7g_e0832f8b-30ec-40dd-bcdb-cddc19fd657d/migrator/0.log"
Nov 03 05:55:21.424657 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.424629    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:21.555741 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.555715    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:21.555899 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.555756    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:21.555899 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:21.555863    4418 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 03 05:55:21.556011 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:21.555925    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs podName:e4e3fb98-d6df-4769-8ee4-53219b93176e nodeName:}" failed. No retries permitted until 2026-11-03 05:55:29.555909014 +0000 UTC m=+16.925859081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs") pod "network-metrics-daemon-42ps6" (UID: "e4e3fb98-d6df-4769-8ee4-53219b93176e") : secret "metrics-daemon-secret" not found
Nov 03 05:55:21.557938 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.557920    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4-metrics-tls\") pod \"dns-default-7zjvt\" (UID: \"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4\") " pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:21.584512 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.584479    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:21.649277 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.649250    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:21.827808 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.827732    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:21.878287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.878258    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zjvt"]
Nov 03 05:55:21.881905 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:21.881874    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d213c9f_f744_4f2f_a7f8_8cddb5abb8e4.slice/crio-ffe18bc536bf4989f34e4d77f20bba4eea813550788d9ec24c53b2dd025d656b WatchSource:0}: Error finding container ffe18bc536bf4989f34e4d77f20bba4eea813550788d9ec24c53b2dd025d656b: Status 404 returned error can't find the container with id ffe18bc536bf4989f34e4d77f20bba4eea813550788d9ec24c53b2dd025d656b
Nov 03 05:55:21.996996 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:21.996953    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:22.156764 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:22.156728    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:22.319270 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:22.319221    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:22.840799 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:22.840770    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zjvt" event={"ID":"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4","Type":"ContainerStarted","Data":"ffe18bc536bf4989f34e4d77f20bba4eea813550788d9ec24c53b2dd025d656b"}
Nov 03 05:55:22.862473 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:22.862436    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:23.447253 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:23.447218    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:23.626528 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:23.626481    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:23.833146 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:23.833114    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:23.844918 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:23.844891    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zjvt" event={"ID":"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4","Type":"ContainerStarted","Data":"9f8481cdfcad779ca604df3741a9cadbc0b1519b16b492ed0628bfe372d0bad6"}
Nov 03 05:55:23.845052 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:23.844934    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zjvt" event={"ID":"7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4","Type":"ContainerStarted","Data":"cddc103257cf3fbcf78e89a5047c6d0ec1f87ce25f83dd90dbde9c33131d7a6e"}
Nov 03 05:55:23.845113 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:23.845051    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:24.028003 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:24.027923    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:24.227313 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:24.227269    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:25.174298 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:25.174260    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:25.341610 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:25.341577    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:25.499125 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:25.499043    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:25.673774 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:25.673741    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:25.843189 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:25.843105    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:26.003153 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:26.003117    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:26.178480 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:26.178449    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:26.339484 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:26.339454    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:26.627158 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:26.627124    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:26.787623 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:26.787591    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:26.948514 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:26.948421    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:27.109478 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:27.109450    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:28.403016 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:28.402984    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:55:29.620215 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:29.620177    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:29.622430 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:29.622402    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4e3fb98-d6df-4769-8ee4-53219b93176e-metrics-certs\") pod \"network-metrics-daemon-42ps6\" (UID: \"e4e3fb98-d6df-4769-8ee4-53219b93176e\") " pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:29.681555 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:29.681521    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-42ps6"
Nov 03 05:55:29.974091 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:29.974017    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-42ps6"]
Nov 03 05:55:29.977669 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:29.977631    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e3fb98_d6df_4769_8ee4_53219b93176e.slice/crio-be86dd303e6a833592f85fb2670e1431031060ac4a2970ec8988ea54db96c284 WatchSource:0}: Error finding container be86dd303e6a833592f85fb2670e1431031060ac4a2970ec8988ea54db96c284: Status 404 returned error can't find the container with id be86dd303e6a833592f85fb2670e1431031060ac4a2970ec8988ea54db96c284
Nov 03 05:55:30.562204 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.562170    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"]
Nov 03 05:55:30.565222 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.565202    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"
Nov 03 05:55:30.574554 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.574533    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-phkl4"]
Nov 03 05:55:30.577310 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.577289    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.582315 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.582296    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s5nll\""
Nov 03 05:55:30.586825 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.586797    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Nov 03 05:55:30.595030 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.595009    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"]
Nov 03 05:55:30.595495 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.595465    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 03 05:55:30.600734 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.600707    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-phkl4"]
Nov 03 05:55:30.600827 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.600793    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 03 05:55:30.682686 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.682653    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-9vr5s\""
Nov 03 05:55:30.728855 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.728826    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246d313e-4827-406e-9fba-127271c2254c-tmp\") pod \"downloads-6dd789c8b7-phkl4\" (UID: \"246d313e-4827-406e-9fba-127271c2254c\") " pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.728999 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.728874    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvtwn\" (UniqueName: \"kubernetes.io/projected/246d313e-4827-406e-9fba-127271c2254c-kube-api-access-lvtwn\") pod \"downloads-6dd789c8b7-phkl4\" (UID: \"246d313e-4827-406e-9fba-127271c2254c\") " pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.728999 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.728894    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/57b5cfa3-0cc5-40f9-b04a-32c865d60876-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wstbd\" (UID: \"57b5cfa3-0cc5-40f9-b04a-32c865d60876\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"
Nov 03 05:55:30.781088 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.781052    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:30.830081 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.830053    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246d313e-4827-406e-9fba-127271c2254c-tmp\") pod \"downloads-6dd789c8b7-phkl4\" (UID: \"246d313e-4827-406e-9fba-127271c2254c\") " pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.830224 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.830096    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvtwn\" (UniqueName: \"kubernetes.io/projected/246d313e-4827-406e-9fba-127271c2254c-kube-api-access-lvtwn\") pod \"downloads-6dd789c8b7-phkl4\" (UID: \"246d313e-4827-406e-9fba-127271c2254c\") " pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.830224 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.830115    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/57b5cfa3-0cc5-40f9-b04a-32c865d60876-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wstbd\" (UID: \"57b5cfa3-0cc5-40f9-b04a-32c865d60876\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"
Nov 03 05:55:30.830462 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.830440    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246d313e-4827-406e-9fba-127271c2254c-tmp\") pod \"downloads-6dd789c8b7-phkl4\" (UID: \"246d313e-4827-406e-9fba-127271c2254c\") " pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.832239 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.832222    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/57b5cfa3-0cc5-40f9-b04a-32c865d60876-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wstbd\" (UID: \"57b5cfa3-0cc5-40f9-b04a-32c865d60876\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"
Nov 03 05:55:30.848562 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.848541    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-795c6d465-sln6d"]
Nov 03 05:55:30.851186 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.851170    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:30.858064 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.858043    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvtwn\" (UniqueName: \"kubernetes.io/projected/246d313e-4827-406e-9fba-127271c2254c-kube-api-access-lvtwn\") pod \"downloads-6dd789c8b7-phkl4\" (UID: \"246d313e-4827-406e-9fba-127271c2254c\") " pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.869529 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.869043    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 03 05:55:30.869529 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.869124    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 03 05:55:30.869529 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.869136    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 03 05:55:30.871162 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.871140    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-42ps6" event={"ID":"e4e3fb98-d6df-4769-8ee4-53219b93176e","Type":"ContainerStarted","Data":"1550add17e67bbe6e52188a75f1efbc01a2b10679dc0dfcc14cc5ffe0126faa0"}
Nov 03 05:55:30.871269 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.871194    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-42ps6" event={"ID":"e4e3fb98-d6df-4769-8ee4-53219b93176e","Type":"ContainerStarted","Data":"be86dd303e6a833592f85fb2670e1431031060ac4a2970ec8988ea54db96c284"}
Nov 03 05:55:30.873834 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.873811    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795c6d465-sln6d"]
Nov 03 05:55:30.878999 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.878971    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"
Nov 03 05:55:30.883211 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.883188    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tw5zl\""
Nov 03 05:55:30.883297 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.883252    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 03 05:55:30.883336 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.883324    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 03 05:55:30.890022 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.890003    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:30.958399 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:30.958361    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:31.031652 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.031609    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-oauth-config\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.031834 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.031664    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-config\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.031834 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.031749    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfz9c\" (UniqueName: \"kubernetes.io/projected/7554212c-f391-4076-9e3d-a4f0a813d4f5-kube-api-access-nfz9c\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.031834 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.031788    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-serving-cert\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.031834 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.031811    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-oauth-serving-cert\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.032043 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.031921    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7554212c-f391-4076-9e3d-a4f0a813d4f5-tmp\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.032043 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.031969    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-service-ca\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.132985 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.132954    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-config\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133146 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.132990    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfz9c\" (UniqueName: \"kubernetes.io/projected/7554212c-f391-4076-9e3d-a4f0a813d4f5-kube-api-access-nfz9c\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133146 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133016    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-serving-cert\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133146 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133032    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-oauth-serving-cert\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133374 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133157    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7554212c-f391-4076-9e3d-a4f0a813d4f5-tmp\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133374 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133217    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-service-ca\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133374 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133252    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-oauth-config\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133586 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133552    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7554212c-f391-4076-9e3d-a4f0a813d4f5-tmp\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133818 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133800    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-oauth-serving-cert\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133878 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133851    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-config\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.133934 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.133913    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-service-ca\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.135449 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.135429    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-oauth-config\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.135599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.135583    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-serving-cert\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.156049 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.156022    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfz9c\" (UniqueName: \"kubernetes.io/projected/7554212c-f391-4076-9e3d-a4f0a813d4f5-kube-api-access-nfz9c\") pod \"console-795c6d465-sln6d\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") " pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.171868 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.171843    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:31.183297 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.183256    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"]
Nov 03 05:55:31.186613 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:31.186581    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b5cfa3_0cc5_40f9_b04a_32c865d60876.slice/crio-c03354761c1257bd18af84669cc1acfb8cc7e0f0532af34ec8fa86984c8d29df WatchSource:0}: Error finding container c03354761c1257bd18af84669cc1acfb8cc7e0f0532af34ec8fa86984c8d29df: Status 404 returned error can't find the container with id c03354761c1257bd18af84669cc1acfb8cc7e0f0532af34ec8fa86984c8d29df
Nov 03 05:55:31.196382 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.196356    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-phkl4"]
Nov 03 05:55:31.201655 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:31.201630    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246d313e_4827_406e_9fba_127271c2254c.slice/crio-3a90fe4849b36ac38f04a9c9456f67e150e89cdf83da7e577cd6957ecc9ca10d WatchSource:0}: Error finding container 3a90fe4849b36ac38f04a9c9456f67e150e89cdf83da7e577cd6957ecc9ca10d: Status 404 returned error can't find the container with id 3a90fe4849b36ac38f04a9c9456f67e150e89cdf83da7e577cd6957ecc9ca10d
Nov 03 05:55:31.469229 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.469153    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795c6d465-sln6d"]
Nov 03 05:55:31.472403 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:31.472377    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7554212c_f391_4076_9e3d_a4f0a813d4f5.slice/crio-669f34a914f8f8b1a35998e222624406e95e4a31df72e170755f883933da6717 WatchSource:0}: Error finding container 669f34a914f8f8b1a35998e222624406e95e4a31df72e170755f883933da6717: Status 404 returned error can't find the container with id 669f34a914f8f8b1a35998e222624406e95e4a31df72e170755f883933da6717
Nov 03 05:55:31.877535 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.877199    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-42ps6" event={"ID":"e4e3fb98-d6df-4769-8ee4-53219b93176e","Type":"ContainerStarted","Data":"3fc70c9c9a873852190801b30ec4bbb4fd024b9beb51734940463db5a4b782e9"}
Nov 03 05:55:31.880000 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.879945    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd" event={"ID":"57b5cfa3-0cc5-40f9-b04a-32c865d60876","Type":"ContainerStarted","Data":"c03354761c1257bd18af84669cc1acfb8cc7e0f0532af34ec8fa86984c8d29df"}
Nov 03 05:55:31.881366 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.881316    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795c6d465-sln6d" event={"ID":"7554212c-f391-4076-9e3d-a4f0a813d4f5","Type":"ContainerStarted","Data":"669f34a914f8f8b1a35998e222624406e95e4a31df72e170755f883933da6717"}
Nov 03 05:55:31.882520 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:31.882480    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-phkl4" event={"ID":"246d313e-4827-406e-9fba-127271c2254c","Type":"ContainerStarted","Data":"3a90fe4849b36ac38f04a9c9456f67e150e89cdf83da7e577cd6957ecc9ca10d"}
Nov 03 05:55:32.248569 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:32.248542    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hcd9r"
Nov 03 05:55:32.889802 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:32.889769    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd" event={"ID":"57b5cfa3-0cc5-40f9-b04a-32c865d60876","Type":"ContainerStarted","Data":"2d0cdfd6233cd953b4bfaf7dfa522653bf5d7e1686600367f4554c3ec3e015e3"}
Nov 03 05:55:32.890272 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:32.890096    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"
Nov 03 05:55:32.900798 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:32.900766    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd"
Nov 03 05:55:32.928441 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:32.928387    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wstbd" podStartSLOduration=1.915493809 podStartE2EDuration="2.92837571s" totalImagesPullingTime="1.012881901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:32.928334089 +0000 UTC m=+20.298284176" watchObservedRunningTime="2026-11-03 05:55:32.92837571 +0000 UTC m=+20.298325787"
Nov 03 05:55:33.598163 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.598106    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:33.644437 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.644405    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"]
Nov 03 05:55:33.648244 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.648218    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.679348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.679201    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 03 05:55:33.679348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.679306    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 03 05:55:33.679348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.679327    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 03 05:55:33.679663 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.679416    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 03 05:55:33.679663 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.679477    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h5q6c\""
Nov 03 05:55:33.679663 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.679555    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 03 05:55:33.693343 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.693311    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"]
Nov 03 05:55:33.749859 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.749819    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8xlx\" (UniqueName: \"kubernetes.io/projected/532477c3-7a46-4cf5-9020-66c87d467ec3-kube-api-access-m8xlx\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.750045 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.749900    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/532477c3-7a46-4cf5-9020-66c87d467ec3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.750045 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.749976    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/532477c3-7a46-4cf5-9020-66c87d467ec3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.750045 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.750017    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/532477c3-7a46-4cf5-9020-66c87d467ec3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.756938 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.756890    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:33.850662 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.850537    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/532477c3-7a46-4cf5-9020-66c87d467ec3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.850662 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.850590    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/532477c3-7a46-4cf5-9020-66c87d467ec3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.850662 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.850620    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/532477c3-7a46-4cf5-9020-66c87d467ec3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.850937 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.850663    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8xlx\" (UniqueName: \"kubernetes.io/projected/532477c3-7a46-4cf5-9020-66c87d467ec3-kube-api-access-m8xlx\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.850937 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.850806    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7zjvt"
Nov 03 05:55:33.851336 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.851313    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/532477c3-7a46-4cf5-9020-66c87d467ec3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.853414 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.853385    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/532477c3-7a46-4cf5-9020-66c87d467ec3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.853553 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.853537    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/532477c3-7a46-4cf5-9020-66c87d467ec3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.873843 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.873813    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8xlx\" (UniqueName: \"kubernetes.io/projected/532477c3-7a46-4cf5-9020-66c87d467ec3-kube-api-access-m8xlx\") pod \"prometheus-operator-9cd89b74c-7jqcf\" (UID: \"532477c3-7a46-4cf5-9020-66c87d467ec3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:33.918842 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.918798    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:33.964923 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:33.964689    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"
Nov 03 05:55:34.278357 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:34.278318    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf"]
Nov 03 05:55:34.284637 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:34.284598    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532477c3_7a46_4cf5_9020_66c87d467ec3.slice/crio-bd9827055f3435932dde3c1560039837eb04e39e133430041ae95532ce857c48 WatchSource:0}: Error finding container bd9827055f3435932dde3c1560039837eb04e39e133430041ae95532ce857c48: Status 404 returned error can't find the container with id bd9827055f3435932dde3c1560039837eb04e39e133430041ae95532ce857c48
Nov 03 05:55:34.897308 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:34.897272    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf" event={"ID":"532477c3-7a46-4cf5-9020-66c87d467ec3","Type":"ContainerStarted","Data":"bd9827055f3435932dde3c1560039837eb04e39e133430041ae95532ce857c48"}
Nov 03 05:55:34.899595 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:34.899566    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795c6d465-sln6d" event={"ID":"7554212c-f391-4076-9e3d-a4f0a813d4f5","Type":"ContainerStarted","Data":"ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72"}
Nov 03 05:55:34.941538 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:34.941464    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-795c6d465-sln6d" podStartSLOduration=1.969824647 podStartE2EDuration="4.941445781s" totalImagesPullingTime="2.971621134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:34.941052328 +0000 UTC m=+22.311002423" watchObservedRunningTime="2026-11-03 05:55:34.941445781 +0000 UTC m=+22.311395866"
Nov 03 05:55:35.904937 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:35.904895    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf" event={"ID":"532477c3-7a46-4cf5-9020-66c87d467ec3","Type":"ContainerStarted","Data":"35320cc7a9811f473f964fb5fc2c4abf517a387a570198c01be918658ec8e775"}
Nov 03 05:55:35.905115 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:35.904963    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf" event={"ID":"532477c3-7a46-4cf5-9020-66c87d467ec3","Type":"ContainerStarted","Data":"6d181646563be250b7922cf23a74ca63ad035c9ad19530031a01f41be81b7ea5"}
Nov 03 05:55:35.945305 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:35.945251    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-7jqcf" podStartSLOduration=1.765231736 podStartE2EDuration="2.945235206s" totalImagesPullingTime="1.18000347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:35.944823276 +0000 UTC m=+23.314773373" watchObservedRunningTime="2026-11-03 05:55:35.945235206 +0000 UTC m=+23.315185291"
Nov 03 05:55:36.403077 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:36.403040    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:38.030189 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.030155    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:38.222998 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.222959    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:38.371534 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.371494    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cwt9w"]
Nov 03 05:55:38.375328 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.375303    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.402308 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.402283    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 03 05:55:38.402308 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.402306    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 03 05:55:38.402519 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.402286    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cbdsf\""
Nov 03 05:55:38.404445 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.404421    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:38.405651 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.405637    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 03 05:55:38.487373 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487343    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-root\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487514 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487382    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-sys\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487514 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487414    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487611 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487562    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-tls\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487611 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487594    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgcnh\" (UniqueName: \"kubernetes.io/projected/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-kube-api-access-pgcnh\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487676 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487622    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487724 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487711    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-metrics-client-ca\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487759 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487740    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-wtmp\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.487867 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.487768    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-textfile\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.570729 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.570704    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:38.588521 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588479    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588632 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588614    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-metrics-client-ca\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588687 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588648    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-wtmp\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588687 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588674    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-textfile\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588787 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588703    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-root\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588787 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588729    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-sys\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588787 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588760    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588929 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588793    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-tls\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588929 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588824    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgcnh\" (UniqueName: \"kubernetes.io/projected/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-kube-api-access-pgcnh\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588929 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588826    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-wtmp\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588929 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588832    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-root\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.588929 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.588849    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-sys\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.589163 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.589130    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-textfile\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.589217 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.589187    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.589411 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.589388    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-metrics-client-ca\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.591440 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.591409    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.591537 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.591485    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-node-exporter-tls\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.614293 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.614270    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgcnh\" (UniqueName: \"kubernetes.io/projected/c8bc82ad-78ff-47bd-99d0-862cc9f393c9-kube-api-access-pgcnh\") pod \"node-exporter-cwt9w\" (UID: \"c8bc82ad-78ff-47bd-99d0-862cc9f393c9\") " pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.691774 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.691721    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cwt9w"
Nov 03 05:55:38.703623 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:38.703594    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8bc82ad_78ff_47bd_99d0_862cc9f393c9.slice/crio-eab7f11d953e2d62446f079a79b57ecebbf0607d69e6f6f7d7152bc22a89e804 WatchSource:0}: Error finding container eab7f11d953e2d62446f079a79b57ecebbf0607d69e6f6f7d7152bc22a89e804: Status 404 returned error can't find the container with id eab7f11d953e2d62446f079a79b57ecebbf0607d69e6f6f7d7152bc22a89e804
Nov 03 05:55:38.845535 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.845486    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:38.919485 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:38.919454    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwt9w" event={"ID":"c8bc82ad-78ff-47bd-99d0-862cc9f393c9","Type":"ContainerStarted","Data":"eab7f11d953e2d62446f079a79b57ecebbf0607d69e6f6f7d7152bc22a89e804"}
Nov 03 05:55:39.008154 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.008077    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:39.412762 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.412724    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:39.640571 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.640540    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 05:55:39.644296 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.644269    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.659293 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.659271    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 03 05:55:39.659440 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.659348    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 03 05:55:39.659440 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.659394    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 03 05:55:39.659440 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.659357    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 03 05:55:39.659638 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.659443    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 03 05:55:39.659638 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.659489    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 03 05:55:39.659638 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.659614    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 03 05:55:39.670644 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.670623    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 03 05:55:39.670739 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.670646    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mt6jq\""
Nov 03 05:55:39.670797 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.670747    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 03 05:55:39.674775 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.674750    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 05:55:39.679719 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.679695    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:39.797896 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.797859    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-out\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798023 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.797909    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798023 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.797958    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798023 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.797989    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj26c\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-kube-api-access-lj26c\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798026    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798051    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798073    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798096    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-volume\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798119    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798150    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798195 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798180    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798536 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798204    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-web-config\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.798536 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.798218    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.842056 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.842003    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898771    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-out\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898817    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898848    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898865    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj26c\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-kube-api-access-lj26c\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898886    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898910    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898932    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898952    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-volume\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.898994    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.899028    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.899070    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.899107    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-web-config\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.899301 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.899132    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.900052 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.899684    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.901084 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.900839    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.901084 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.901016    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.901685 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.901659    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.903059 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.903040    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.903232 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.903201    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-out\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.904568 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.903357    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.904568 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.903670    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.904568 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.903949    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-web-config\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.904568 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.904224    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.905764 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.905735    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-volume\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.905847 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.905769    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.921944 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.921897    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj26c\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-kube-api-access-lj26c\") pod \"alertmanager-main-0\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:39.925079 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.925053    4418 generic.go:356] "Generic (PLEG): container finished" podID="c8bc82ad-78ff-47bd-99d0-862cc9f393c9" containerID="854f049d4b403d73a91ef0f8abfffbbbb9b1d3ece9c8aec8d11c615bc96d3ab7" exitCode=0
Nov 03 05:55:39.925167 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.925101    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwt9w" event={"ID":"c8bc82ad-78ff-47bd-99d0-862cc9f393c9","Type":"ContainerDied","Data":"854f049d4b403d73a91ef0f8abfffbbbb9b1d3ece9c8aec8d11c615bc96d3ab7"}
Nov 03 05:55:39.972214 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:39.972174    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:55:40.306377 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.306305    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 05:55:40.309105 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:40.309079    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42de6f37_ac3f_454e_a5ac_43dba2501fa3.slice/crio-24fd16f8df739c989cdb65d2ca07a8dd8eb5f9a8af49f11d856e2862764228e5 WatchSource:0}: Error finding container 24fd16f8df739c989cdb65d2ca07a8dd8eb5f9a8af49f11d856e2862764228e5: Status 404 returned error can't find the container with id 24fd16f8df739c989cdb65d2ca07a8dd8eb5f9a8af49f11d856e2862764228e5
Nov 03 05:55:40.442049 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.442016    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"]
Nov 03 05:55:40.446093 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.446071    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.464680 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.464661    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 03 05:55:40.464805 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.464661    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 03 05:55:40.464805 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.464731    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 03 05:55:40.464805 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.464748    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 03 05:55:40.464919 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.464877    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8m6i5at0rkheu\""
Nov 03 05:55:40.465001 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.464988    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 03 05:55:40.465037 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.465030    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rs6gt\""
Nov 03 05:55:40.473182 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.473160    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"]
Nov 03 05:55:40.606038 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.605954    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606038 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.605992    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606038 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.606016    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-grpc-tls\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.606118    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a929c08f-96a7-49cf-8e76-9d9ac6389c10-metrics-client-ca\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.606154    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-tls\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.606177    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.606232    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606302 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.606266    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a929c08f-96a7-49cf-8e76-9d9ac6389c10-tmp\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.606635 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.606334    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2ljs\" (UniqueName: \"kubernetes.io/projected/a929c08f-96a7-49cf-8e76-9d9ac6389c10-kube-api-access-d2ljs\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.706757 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706726    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a929c08f-96a7-49cf-8e76-9d9ac6389c10-metrics-client-ca\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.706902 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706775    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-tls\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.706902 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706806    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.706902 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706830    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.706902 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706846    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a929c08f-96a7-49cf-8e76-9d9ac6389c10-tmp\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.706902 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706876    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2ljs\" (UniqueName: \"kubernetes.io/projected/a929c08f-96a7-49cf-8e76-9d9ac6389c10-kube-api-access-d2ljs\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.707165 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706914    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.707165 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706932    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.707165 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.706960    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-grpc-tls\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.707853 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.707491    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a929c08f-96a7-49cf-8e76-9d9ac6389c10-tmp\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.707853 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.707621    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a929c08f-96a7-49cf-8e76-9d9ac6389c10-metrics-client-ca\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.709862 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.709812    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-tls\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.709999 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.709960    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-grpc-tls\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.710467 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.710443    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.710584 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.710553    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.710636 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.710620    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.711676 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.711653    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a929c08f-96a7-49cf-8e76-9d9ac6389c10-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.730814 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.730795    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2ljs\" (UniqueName: \"kubernetes.io/projected/a929c08f-96a7-49cf-8e76-9d9ac6389c10-kube-api-access-d2ljs\") pod \"thanos-querier-7cc5bcb78b-rhz4c\" (UID: \"a929c08f-96a7-49cf-8e76-9d9ac6389c10\") " pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.769117 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.769087    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:40.931267 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.931231    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwt9w" event={"ID":"c8bc82ad-78ff-47bd-99d0-862cc9f393c9","Type":"ContainerStarted","Data":"90d4a26c40c20050692f854b7e610aee5bf7f9ae62fbfa121dae4d3ba05a8155"}
Nov 03 05:55:40.931435 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.931298    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cwt9w" event={"ID":"c8bc82ad-78ff-47bd-99d0-862cc9f393c9","Type":"ContainerStarted","Data":"9e63e829b35eabcf4a77801e0bb5abe752f72e509635609013dcaf617725c74b"}
Nov 03 05:55:40.933154 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.933074    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerStarted","Data":"24fd16f8df739c989cdb65d2ca07a8dd8eb5f9a8af49f11d856e2862764228e5"}
Nov 03 05:55:40.974446 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:40.974378    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cwt9w" podStartSLOduration=1.932443579 podStartE2EDuration="2.974366317s" totalImagesPullingTime="965.72412ms" totalInitContainerRuntime="76.198618ms" isStatefulPod=true podCreationTimestamp="2026-11-03 05:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:40.973742608 +0000 UTC m=+28.343692694" watchObservedRunningTime="2026-11-03 05:55:40.974366317 +0000 UTC m=+28.344316400"
Nov 03 05:55:41.096348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.096312    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"]
Nov 03 05:55:41.100262 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:41.100233    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda929c08f_96a7_49cf_8e76_9d9ac6389c10.slice/crio-243773b1a8fdbce593000ba3f02eea857235e94010f8124c327460dee8e2ac8a WatchSource:0}: Error finding container 243773b1a8fdbce593000ba3f02eea857235e94010f8124c327460dee8e2ac8a: Status 404 returned error can't find the container with id 243773b1a8fdbce593000ba3f02eea857235e94010f8124c327460dee8e2ac8a
Nov 03 05:55:41.172972 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.172945    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:41.173100 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.173007    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:41.178774 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.178753    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:41.609800 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.609706    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:41.769516 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.769466    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:41.939603 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.939565    4418 generic.go:356] "Generic (PLEG): container finished" podID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerID="49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f" exitCode=0
Nov 03 05:55:41.939934 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.939898    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f"}
Nov 03 05:55:41.941331 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.941305    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" event={"ID":"a929c08f-96a7-49cf-8e76-9d9ac6389c10","Type":"ContainerStarted","Data":"243773b1a8fdbce593000ba3f02eea857235e94010f8124c327460dee8e2ac8a"}
Nov 03 05:55:41.946293 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:41.946270    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:55:42.991442 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:42.991406    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79bf56848b-hz9r2"]
Nov 03 05:55:43.010915 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.010890    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.023949 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.023923    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79bf56848b-hz9r2"]
Nov 03 05:55:43.033840 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.033816    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 03 05:55:43.033967 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.033868    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rdbzj\""
Nov 03 05:55:43.037601 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.037466    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:43.037966 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.037922    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-185m61kvn83i9\""
Nov 03 05:55:43.037966 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.037922    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 03 05:55:43.037966 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.037926    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 03 05:55:43.037966 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.037960    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 03 05:55:43.123664 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.123633    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"]
Nov 03 05:55:43.128875 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.128840    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-secret-metrics-server-client-certs\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.129003 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.128898    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/230a6e7c-e739-4159-8ece-4b822c5edf2a-metrics-server-audit-profiles\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.129076 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.129002    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knjgb\" (UniqueName: \"kubernetes.io/projected/230a6e7c-e739-4159-8ece-4b822c5edf2a-kube-api-access-knjgb\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.129076 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.129035    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/230a6e7c-e739-4159-8ece-4b822c5edf2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.129180 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.129080    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/230a6e7c-e739-4159-8ece-4b822c5edf2a-audit-log\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.129772 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.129750    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-secret-metrics-server-tls\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.129950 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.129845    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-client-ca-bundle\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.151116 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.150209    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"]
Nov 03 05:55:43.151116 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.150305    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.182729 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.182703    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hjmk6\""
Nov 03 05:55:43.182729 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.182703    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 03 05:55:43.210213 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.210178    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:43.230718 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.230683    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knjgb\" (UniqueName: \"kubernetes.io/projected/230a6e7c-e739-4159-8ece-4b822c5edf2a-kube-api-access-knjgb\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.230873 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.230740    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/230a6e7c-e739-4159-8ece-4b822c5edf2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.230873 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.230763    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/230a6e7c-e739-4159-8ece-4b822c5edf2a-audit-log\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.230873 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.230788    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-secret-metrics-server-tls\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.230873 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.230817    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-client-ca-bundle\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.230873 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.230863    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-secret-metrics-server-client-certs\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.231117 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.230898    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/230a6e7c-e739-4159-8ece-4b822c5edf2a-metrics-server-audit-profiles\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.232110 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.232084    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/230a6e7c-e739-4159-8ece-4b822c5edf2a-metrics-server-audit-profiles\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.233010 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.232989    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/230a6e7c-e739-4159-8ece-4b822c5edf2a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.233310 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.233286    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/230a6e7c-e739-4159-8ece-4b822c5edf2a-audit-log\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.238024 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.237996    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-client-ca-bundle\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.238448 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.238427    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-secret-metrics-server-tls\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.249038 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.248987    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/230a6e7c-e739-4159-8ece-4b822c5edf2a-secret-metrics-server-client-certs\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.256141 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.256121    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knjgb\" (UniqueName: \"kubernetes.io/projected/230a6e7c-e739-4159-8ece-4b822c5edf2a-kube-api-access-knjgb\") pod \"metrics-server-79bf56848b-hz9r2\" (UID: \"230a6e7c-e739-4159-8ece-4b822c5edf2a\") " pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.331845 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.331803    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/131f2b49-2945-4a74-8865-3fa39d5c196c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-jl2hw\" (UID: \"131f2b49-2945-4a74-8865-3fa39d5c196c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.332012 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.331878    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5dgj\" (UniqueName: \"kubernetes.io/projected/131f2b49-2945-4a74-8865-3fa39d5c196c-kube-api-access-z5dgj\") pod \"monitoring-plugin-77f4f76594-jl2hw\" (UID: \"131f2b49-2945-4a74-8865-3fa39d5c196c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.347353 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.347320    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:55:43.387034 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.386896    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:43.436362 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.432992    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/131f2b49-2945-4a74-8865-3fa39d5c196c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-jl2hw\" (UID: \"131f2b49-2945-4a74-8865-3fa39d5c196c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.436362 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.433036    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5dgj\" (UniqueName: \"kubernetes.io/projected/131f2b49-2945-4a74-8865-3fa39d5c196c-kube-api-access-z5dgj\") pod \"monitoring-plugin-77f4f76594-jl2hw\" (UID: \"131f2b49-2945-4a74-8865-3fa39d5c196c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.436362 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.435809    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/131f2b49-2945-4a74-8865-3fa39d5c196c-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-jl2hw\" (UID: \"131f2b49-2945-4a74-8865-3fa39d5c196c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.462095 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.462061    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5dgj\" (UniqueName: \"kubernetes.io/projected/131f2b49-2945-4a74-8865-3fa39d5c196c-kube-api-access-z5dgj\") pod \"monitoring-plugin-77f4f76594-jl2hw\" (UID: \"131f2b49-2945-4a74-8865-3fa39d5c196c\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.480075 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.480050    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:43.595843 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.590269    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:43.679154 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.679123    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79bf56848b-hz9r2"]
Nov 03 05:55:43.759777 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:43.759745    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230a6e7c_e739_4159_8ece_4b822c5edf2a.slice/crio-8dff4acb5f24ee3bd2d5ae8117291c8df2905aa5b00df1f13e35a8d4c6541534 WatchSource:0}: Error finding container 8dff4acb5f24ee3bd2d5ae8117291c8df2905aa5b00df1f13e35a8d4c6541534: Status 404 returned error can't find the container with id 8dff4acb5f24ee3bd2d5ae8117291c8df2905aa5b00df1f13e35a8d4c6541534
Nov 03 05:55:43.825496 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.825389    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"]
Nov 03 05:55:43.939246 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:43.939205    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131f2b49_2945_4a74_8865_3fa39d5c196c.slice/crio-79a7c8e74f7fcd83787ce507400f473a6ff0fbef8441aae6557a6a06b2dc4d4f WatchSource:0}: Error finding container 79a7c8e74f7fcd83787ce507400f473a6ff0fbef8441aae6557a6a06b2dc4d4f: Status 404 returned error can't find the container with id 79a7c8e74f7fcd83787ce507400f473a6ff0fbef8441aae6557a6a06b2dc4d4f
Nov 03 05:55:43.949440 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.949411    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2" event={"ID":"230a6e7c-e739-4159-8ece-4b822c5edf2a","Type":"ContainerStarted","Data":"8dff4acb5f24ee3bd2d5ae8117291c8df2905aa5b00df1f13e35a8d4c6541534"}
Nov 03 05:55:43.950771 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:43.950737    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw" event={"ID":"131f2b49-2945-4a74-8865-3fa39d5c196c","Type":"ContainerStarted","Data":"79a7c8e74f7fcd83787ce507400f473a6ff0fbef8441aae6557a6a06b2dc4d4f"}
Nov 03 05:55:44.231059 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.231027    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:44.403132 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.403100    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:44.959324 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.959159    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" event={"ID":"a929c08f-96a7-49cf-8e76-9d9ac6389c10","Type":"ContainerStarted","Data":"c9a79ce53a4d3eff80688a699896e7e2de01a7a6534121fae4184ca5d1b38ae7"}
Nov 03 05:55:44.959324 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.959246    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" event={"ID":"a929c08f-96a7-49cf-8e76-9d9ac6389c10","Type":"ContainerStarted","Data":"a539f6258ae3aed1e59442ea874a89a70a592693f56d486af022e472df8d3dea"}
Nov 03 05:55:44.959324 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.959277    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" event={"ID":"a929c08f-96a7-49cf-8e76-9d9ac6389c10","Type":"ContainerStarted","Data":"0456d082610ab14a36359cb5e229d57b74788771a3f59663ba658ca7f3332277"}
Nov 03 05:55:44.964638 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.964608    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerStarted","Data":"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"}
Nov 03 05:55:44.964777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.964679    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerStarted","Data":"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"}
Nov 03 05:55:44.964777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.964721    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerStarted","Data":"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"}
Nov 03 05:55:44.964777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.964759    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerStarted","Data":"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"}
Nov 03 05:55:44.964944 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:44.964807    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerStarted","Data":"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"}
Nov 03 05:55:45.276358 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.274464    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:55:45.294561 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.294532    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.309663 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.309637    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 03 05:55:45.310762 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.310739    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 03 05:55:45.321479 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321018    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7lcm6\""
Nov 03 05:55:45.321479 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321103    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6rbj7htbtaqvq\""
Nov 03 05:55:45.321479 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321231    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 03 05:55:45.321479 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321411    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 03 05:55:45.321479 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321436    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 03 05:55:45.322059 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321710    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 03 05:55:45.322059 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321735    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 03 05:55:45.322059 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.321740    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 03 05:55:45.322273 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.322242    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 03 05:55:45.324093 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.324071    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:55:45.333691 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.328068    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:45.348667 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.348636    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 03 05:55:45.348905 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.348888    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 03 05:55:45.416465 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.413560    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 03 05:55:45.416465 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.413920    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 03 05:55:45.416465 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.414441    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 03 05:55:45.453174 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453134    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453194    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453306    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453351    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453383    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453399    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453420    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453475 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453463    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453496    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453539    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-web-config\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453565    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453581    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kskj\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-kube-api-access-7kskj\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453599    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453625    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453667    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-config\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453690    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453711    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453726    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-config-out\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453741    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.453754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.453759    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.554899 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.554821    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.554899 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.554870    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.554899 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.554914    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.554939    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.554975    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.554993    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555013    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555033    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-web-config\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555064    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555089    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kskj\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-kube-api-access-7kskj\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555115    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555150    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555191    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-config\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555225    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555251    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555275    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-config-out\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555298    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555324    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555358    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.555672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.555387    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.558542 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.557611    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.558542 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.557628    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.558542 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.558228    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.559158 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.558558    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.559158 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.559020    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.559571 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.559301    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.559674 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.559642    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.563549 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.560375    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.563549 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.560416    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.563549 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.562585    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.564037 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.563997    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.564129 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.564114    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.564402 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.564378    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.564891 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.564850    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-web-config\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.569902 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.569849    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.570267 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.570218    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-config-out\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.570438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.570400    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-config\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.570948 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.570904    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.576712 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.576690    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.583982 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.583940    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kskj\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-kube-api-access-7kskj\") pod \"prometheus-k8s-0\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:45.728684 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:45.728485    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:46.099365 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.099292    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:55:46.191756 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:46.191719    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd916d223_53a4_4d96_9bfd_aa70159d5f82.slice/crio-267c85e7adc19855264eead097c1ad0eea70f176eaed6981f47a3cd3bd981211 WatchSource:0}: Error finding container 267c85e7adc19855264eead097c1ad0eea70f176eaed6981f47a3cd3bd981211: Status 404 returned error can't find the container with id 267c85e7adc19855264eead097c1ad0eea70f176eaed6981f47a3cd3bd981211
Nov 03 05:55:46.975905 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.975874    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerStarted","Data":"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"}
Nov 03 05:55:46.977622 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.977592    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2" event={"ID":"230a6e7c-e739-4159-8ece-4b822c5edf2a","Type":"ContainerStarted","Data":"15409ba2b4bf3bbe67552960dfa8d1cd764e6ebe070a84380087b2edd3db411c"}
Nov 03 05:55:46.981009 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.980982    4418 generic.go:356] "Generic (PLEG): container finished" podID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerID="8a61c38855bc60e36ab3be580ac223bd1bdaecb23e3b5ae30f8f780621f95c60" exitCode=0
Nov 03 05:55:46.981122 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.981094    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"8a61c38855bc60e36ab3be580ac223bd1bdaecb23e3b5ae30f8f780621f95c60"}
Nov 03 05:55:46.981194 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.981159    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerStarted","Data":"267c85e7adc19855264eead097c1ad0eea70f176eaed6981f47a3cd3bd981211"}
Nov 03 05:55:46.984531 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.984484    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" event={"ID":"a929c08f-96a7-49cf-8e76-9d9ac6389c10","Type":"ContainerStarted","Data":"d0c2b70555b964c5a4f36c28c5f784a4ffb770fb04360ce73dd77eab7d7f8e93"}
Nov 03 05:55:46.984626 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.984573    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" event={"ID":"a929c08f-96a7-49cf-8e76-9d9ac6389c10","Type":"ContainerStarted","Data":"6ed55be4ad61a4376d8251fc3bb156aaf96487fd8cc5ae6f060d3ed939c45805"}
Nov 03 05:55:46.984626 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.984615    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" event={"ID":"a929c08f-96a7-49cf-8e76-9d9ac6389c10","Type":"ContainerStarted","Data":"a4e1366eeec973cdbf059c9483142ca9a9c8fe479ba4b4427593a4e4435f6dd0"}
Nov 03 05:55:46.984725 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.984655    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:46.986123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.986097    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw" event={"ID":"131f2b49-2945-4a74-8865-3fa39d5c196c","Type":"ContainerStarted","Data":"65cb72e87dfd849b11cf310281503f3940ef1fb557e08406d844d07236abaa8a"}
Nov 03 05:55:46.986455 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.986437    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:46.993154 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:46.993135    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw"
Nov 03 05:55:47.032754 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:47.032712    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.79714456 podStartE2EDuration="8.032696729s" totalImagesPullingTime="5.221389294s" totalInitContainerRuntime="14.162875ms" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:47.031207691 +0000 UTC m=+34.401157776" watchObservedRunningTime="2026-11-03 05:55:47.032696729 +0000 UTC m=+34.402646816"
Nov 03 05:55:47.083448 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:47.083390    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-jl2hw" podStartSLOduration=1.440047306 podStartE2EDuration="4.083375113s" totalImagesPullingTime="2.643327807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:47.082524152 +0000 UTC m=+34.452474228" watchObservedRunningTime="2026-11-03 05:55:47.083375113 +0000 UTC m=+34.453325195"
Nov 03 05:55:47.151751 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:47.151693    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c" podStartSLOduration=1.925296076 podStartE2EDuration="7.151671833s" totalImagesPullingTime="5.226375757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:47.14998943 +0000 UTC m=+34.519939514" watchObservedRunningTime="2026-11-03 05:55:47.151671833 +0000 UTC m=+34.521621919"
Nov 03 05:55:47.196639 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:47.196591    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2" podStartSLOduration=2.5567524600000002 podStartE2EDuration="5.196575059s" totalImagesPullingTime="2.639822599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:47.195288162 +0000 UTC m=+34.565238251" watchObservedRunningTime="2026-11-03 05:55:47.196575059 +0000 UTC m=+34.566525143"
Nov 03 05:55:47.292930 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:47.292900    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8669x"
Nov 03 05:55:49.450581 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:49.450440    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:49.658113 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:49.658076    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:50.008052 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:50.007218    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-phkl4" event={"ID":"246d313e-4827-406e-9fba-127271c2254c","Type":"ContainerStarted","Data":"9dc9631085dd7fcc19a1478a3152669a5c60c093dc57d792e5831bccf9562174"}
Nov 03 05:55:50.008052 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:50.007572    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:50.019149 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:50.019099    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-phkl4"
Nov 03 05:55:50.049093 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:50.049030    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-phkl4" podStartSLOduration=2.28406849 podStartE2EDuration="20.049012006s" totalImagesPullingTime="17.764943516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:50.048437816 +0000 UTC m=+37.418387900" watchObservedRunningTime="2026-11-03 05:55:50.049012006 +0000 UTC m=+37.418962089"
Nov 03 05:55:51.077775 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:51.077742    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:51.276488 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:51.276455    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:51.928298 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:51.928264    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:52.020541 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.020489    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerStarted","Data":"17a8dd58b98d2088defbbe3b563beccffb97d61fbeeb3f00e0ca5eec593d4a38"}
Nov 03 05:55:52.020771 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.020627    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerStarted","Data":"d0f9bd1220d62d3edc4a841332645c7ff31177c4f40683deca76bf3f69e24fa5"}
Nov 03 05:55:52.020771 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.020679    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerStarted","Data":"dde44268de1be9cd6e3f94f62d82c09e7beb2aae6e0630967aa51a6be1a5e62f"}
Nov 03 05:55:52.020771 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.020715    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerStarted","Data":"46b768ccbe7d94b970c06a38589832fc8e08f7cb340c33266a62fb9af7128027"}
Nov 03 05:55:52.020771 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.020748    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerStarted","Data":"9ea5a5c86724fd307b9f8fd85fc7f22c0650104fc4e5128d43a40b3dc5ecf20a"}
Nov 03 05:55:52.020987 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.020783    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerStarted","Data":"258f2df84c35f79289883e6422573b49fc91f037fc80cb0898cc9a0756219afe"}
Nov 03 05:55:52.106378 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.106338    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:52.111652 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:52.111601    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.124381457 podStartE2EDuration="7.111588053s" totalImagesPullingTime="3.953485136s" totalInitContainerRuntime="33.72146ms" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:52.098671029 +0000 UTC m=+39.468621113" watchObservedRunningTime="2026-11-03 05:55:52.111588053 +0000 UTC m=+39.481538136"
Nov 03 05:55:53.005077 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.001981    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cc5bcb78b-rhz4c"
Nov 03 05:55:53.230783 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.230744    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:53.398119 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.398081    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:53.444323 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.444289    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-b765474f4-hdt7x"]
Nov 03 05:55:53.484755 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.484722    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b765474f4-hdt7x"]
Nov 03 05:55:53.484923 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.484869    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.523627 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.523602    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 03 05:55:53.542517 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542471    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8bb6\" (UniqueName: \"kubernetes.io/projected/ade388d6-ed69-4995-8dce-43fa638140bc-kube-api-access-h8bb6\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.542658 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542530    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-console-config\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.542658 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542611    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade388d6-ed69-4995-8dce-43fa638140bc-tmp\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.542658 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542641    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-serving-cert\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.542807 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542695    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-oauth-config\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.542807 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542730    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-service-ca\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.542807 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542771    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-trusted-ca-bundle\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.542807 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.542794    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-oauth-serving-cert\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.643858 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.643821    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bb6\" (UniqueName: \"kubernetes.io/projected/ade388d6-ed69-4995-8dce-43fa638140bc-kube-api-access-h8bb6\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644007 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.643959    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-console-config\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644007 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644002    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade388d6-ed69-4995-8dce-43fa638140bc-tmp\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644124 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644028    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-serving-cert\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644124 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644085    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-oauth-config\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644257 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644230    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-service-ca\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644320 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644296    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-trusted-ca-bundle\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644377 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644333    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-oauth-serving-cert\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644465 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644439    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade388d6-ed69-4995-8dce-43fa638140bc-tmp\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.644997 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.644972    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-oauth-serving-cert\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.645202 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.645180    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-service-ca\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.645770 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.645748    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-trusted-ca-bundle\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.646178 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.646159    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-console-config\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.647053 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.647033    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-serving-cert\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.648363 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.648317    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-oauth-config\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.667191 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.667164    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8bb6\" (UniqueName: \"kubernetes.io/projected/ade388d6-ed69-4995-8dce-43fa638140bc-kube-api-access-h8bb6\") pod \"console-b765474f4-hdt7x\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") " pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:53.814424 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:53.814391    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:55:54.130805 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:54.130717    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:54.144536 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:54.144490    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b765474f4-hdt7x"]
Nov 03 05:55:54.148130 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:55:54.148104    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade388d6_ed69_4995_8dce_43fa638140bc.slice/crio-b26fdf66c01c684c5588ebebe0d862145e55ed17d229f2a34983d0f9d26c9eb1 WatchSource:0}: Error finding container b26fdf66c01c684c5588ebebe0d862145e55ed17d229f2a34983d0f9d26c9eb1: Status 404 returned error can't find the container with id b26fdf66c01c684c5588ebebe0d862145e55ed17d229f2a34983d0f9d26c9eb1
Nov 03 05:55:54.287932 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:54.287895    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:54.603544 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:54.603458    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:54.810646 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:54.810613    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:55.040305 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:55.040265    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b765474f4-hdt7x" event={"ID":"ade388d6-ed69-4995-8dce-43fa638140bc","Type":"ContainerStarted","Data":"8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e"}
Nov 03 05:55:55.040477 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:55.040319    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b765474f4-hdt7x" event={"ID":"ade388d6-ed69-4995-8dce-43fa638140bc","Type":"ContainerStarted","Data":"b26fdf66c01c684c5588ebebe0d862145e55ed17d229f2a34983d0f9d26c9eb1"}
Nov 03 05:55:55.084726 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:55.084673    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-b765474f4-hdt7x" podStartSLOduration=2.084657454 podStartE2EDuration="2.084657454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:55:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:55:55.083527591 +0000 UTC m=+42.453477672" watchObservedRunningTime="2026-11-03 05:55:55.084657454 +0000 UTC m=+42.454607542"
Nov 03 05:55:55.729153 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:55.729072    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:55:58.365474 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:58.365445    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:55:58.403767 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:55:58.403734    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:55:58.532662 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:55:58.532635    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:01.236961 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:01.236928    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:01.406332 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:01.406297    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:02.049313 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:02.049280    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:02.208862 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:02.208831    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:03.062384 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:03.062346    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:03.260081 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:03.260044    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:03.347915 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:03.347851    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:56:03.347915 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:03.347904    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:56:03.815371 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:03.815339    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:56:03.815630 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:03.815611    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:56:03.820604 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:03.820587    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:56:04.077968 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:04.077906    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:56:04.150176 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:04.150146    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795c6d465-sln6d"]
Nov 03 05:56:07.730669 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:07.730637    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:07.787428 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:07.787405    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:08.107753 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:08.107678    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:13.364164 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:13.364123    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:13.523746 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:13.523707    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:23.353587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:23.353557    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:56:23.357396 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:23.357371    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79bf56848b-hz9r2"
Nov 03 05:56:24.355586 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:24.355547    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:25.429453 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:25.429415    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:25.598132 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:25.598096    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:25.761368 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:25.761289    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:27.087656 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:27.087626    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:27.250716 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:27.250672    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:28.364533 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:28.364477    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:28.403956 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:28.403922    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:56:28.536643 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:28.536612    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:29.169953 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.169920    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-795c6d465-sln6d" podUID="7554212c-f391-4076-9e3d-a4f0a813d4f5" containerName="console" containerID="cri-o://ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72" gracePeriod=15
Nov 03 05:56:29.399139 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.399111    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 05:56:29.399495 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.399417    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="alertmanager" containerID="cri-o://5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a" gracePeriod=120
Nov 03 05:56:29.399495 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.399470    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-metric" containerID="cri-o://13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172" gracePeriod=120
Nov 03 05:56:29.399638 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.399496    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-web" containerID="cri-o://3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19" gracePeriod=120
Nov 03 05:56:29.399638 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.399536    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy" containerID="cri-o://d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123" gracePeriod=120
Nov 03 05:56:29.399638 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.399560    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="config-reloader" containerID="cri-o://b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4" gracePeriod=120
Nov 03 05:56:29.399807 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.399653    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="prom-label-proxy" containerID="cri-o://41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605" gracePeriod=120
Nov 03 05:56:29.436849 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.436829    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:56:29.539884 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.539860    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-serving-cert\") pod \"7554212c-f391-4076-9e3d-a4f0a813d4f5\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") "
Nov 03 05:56:29.539994 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.539916    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7554212c-f391-4076-9e3d-a4f0a813d4f5-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7554212c-f391-4076-9e3d-a4f0a813d4f5-tmp\") pod \"7554212c-f391-4076-9e3d-a4f0a813d4f5\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") "
Nov 03 05:56:29.540059 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540018    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-service-ca\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-service-ca\") pod \"7554212c-f391-4076-9e3d-a4f0a813d4f5\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") "
Nov 03 05:56:29.540114 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540052    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-oauth-serving-cert\") pod \"7554212c-f391-4076-9e3d-a4f0a813d4f5\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") "
Nov 03 05:56:29.540114 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540107    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-oauth-config\") pod \"7554212c-f391-4076-9e3d-a4f0a813d4f5\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") "
Nov 03 05:56:29.540219 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540136    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-config\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-config\") pod \"7554212c-f391-4076-9e3d-a4f0a813d4f5\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") "
Nov 03 05:56:29.540219 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540157    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7554212c-f391-4076-9e3d-a4f0a813d4f5-tmp" pod "7554212c-f391-4076-9e3d-a4f0a813d4f5" (UID: "7554212c-f391-4076-9e3d-a4f0a813d4f5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:56:29.540219 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540165    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7554212c-f391-4076-9e3d-a4f0a813d4f5-kube-api-access-nfz9c\" (UniqueName: \"kubernetes.io/projected/7554212c-f391-4076-9e3d-a4f0a813d4f5-kube-api-access-nfz9c\") pod \"7554212c-f391-4076-9e3d-a4f0a813d4f5\" (UID: \"7554212c-f391-4076-9e3d-a4f0a813d4f5\") "
Nov 03 05:56:29.540513 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540471    4418 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7554212c-f391-4076-9e3d-a4f0a813d4f5-tmp\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:29.540756 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540354    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-service-ca" pod "7554212c-f391-4076-9e3d-a4f0a813d4f5" (UID: "7554212c-f391-4076-9e3d-a4f0a813d4f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:29.540756 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540554    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-oauth-serving-cert" pod "7554212c-f391-4076-9e3d-a4f0a813d4f5" (UID: "7554212c-f391-4076-9e3d-a4f0a813d4f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:29.540756 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.540551    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-config" pod "7554212c-f391-4076-9e3d-a4f0a813d4f5" (UID: "7554212c-f391-4076-9e3d-a4f0a813d4f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:29.542332 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.542313    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7554212c-f391-4076-9e3d-a4f0a813d4f5-kube-api-access-nfz9c" pod "7554212c-f391-4076-9e3d-a4f0a813d4f5" (UID: "7554212c-f391-4076-9e3d-a4f0a813d4f5"). InnerVolumeSpecName "kube-api-access-nfz9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 05:56:29.542420 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.542402    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-oauth-config" pod "7554212c-f391-4076-9e3d-a4f0a813d4f5" (UID: "7554212c-f391-4076-9e3d-a4f0a813d4f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:29.542462 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.542423    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-serving-cert" pod "7554212c-f391-4076-9e3d-a4f0a813d4f5" (UID: "7554212c-f391-4076-9e3d-a4f0a813d4f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:29.641017 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.640997    4418 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-service-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:29.641017 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.641017    4418 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-oauth-serving-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:29.641162 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.641027    4418 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-oauth-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:29.641162 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.641037    4418 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:29.641162 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.641045    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfz9c\" (UniqueName: \"kubernetes.io/projected/7554212c-f391-4076-9e3d-a4f0a813d4f5-kube-api-access-nfz9c\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:29.641162 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:29.641053    4418 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7554212c-f391-4076-9e3d-a4f0a813d4f5-console-serving-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.171259 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171220    4418 generic.go:356] "Generic (PLEG): container finished" podID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerID="41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605" exitCode=0
Nov 03 05:56:30.171259 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171252    4418 generic.go:356] "Generic (PLEG): container finished" podID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerID="d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123" exitCode=0
Nov 03 05:56:30.171259 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171261    4418 generic.go:356] "Generic (PLEG): container finished" podID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerID="b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4" exitCode=0
Nov 03 05:56:30.171545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171269    4418 generic.go:356] "Generic (PLEG): container finished" podID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerID="5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a" exitCode=0
Nov 03 05:56:30.171545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171277    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"}
Nov 03 05:56:30.171545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171346    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"}
Nov 03 05:56:30.171545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171375    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"}
Nov 03 05:56:30.171545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.171400    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"}
Nov 03 05:56:30.172585 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.172566    4418 generic.go:356] "Generic (PLEG): container finished" podID="7554212c-f391-4076-9e3d-a4f0a813d4f5" containerID="ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72" exitCode=0
Nov 03 05:56:30.172664 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.172598    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795c6d465-sln6d" event={"ID":"7554212c-f391-4076-9e3d-a4f0a813d4f5","Type":"ContainerDied","Data":"ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72"}
Nov 03 05:56:30.172664 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.172612    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795c6d465-sln6d"
Nov 03 05:56:30.172664 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.172623    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795c6d465-sln6d" event={"ID":"7554212c-f391-4076-9e3d-a4f0a813d4f5","Type":"ContainerDied","Data":"669f34a914f8f8b1a35998e222624406e95e4a31df72e170755f883933da6717"}
Nov 03 05:56:30.172664 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.172641    4418 scope.go:122] "RemoveContainer" containerID="ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72"
Nov 03 05:56:30.181406 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.181387    4418 scope.go:122] "RemoveContainer" containerID="ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72"
Nov 03 05:56:30.181758 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:30.181739    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72\": container with ID starting with ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72 not found: ID does not exist" containerID="ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72"
Nov 03 05:56:30.181831 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.181765    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72"} err="failed to get container status \"ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72\": rpc error: code = NotFound desc = could not find container \"ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72\": container with ID starting with ef3b5253b9acf3fbb2ea71c7e4932964b28e1665988461162fe6f017167dcd72 not found: ID does not exist"
Nov 03 05:56:30.221622 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.221597    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795c6d465-sln6d"]
Nov 03 05:56:30.233546 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.233519    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-795c6d465-sln6d"]
Nov 03 05:56:30.668258 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.668228    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:56:30.749181 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749115    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-metrics-client-ca\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749181 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749157    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749181 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749183    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-out\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-out\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749222    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-cluster-tls-config\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749240    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-trusted-ca-bundle\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749283    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-main-tls\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749309    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-web\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749354    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-kube-api-access-lj26c\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-kube-api-access-lj26c\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749386    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749438 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749424    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-web-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-web-config\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749816 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749470    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-volume\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-volume\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749816 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749522    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-tls-assets\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-tls-assets\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749816 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749552    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-main-db\") pod \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\" (UID: \"42de6f37-ac3f-454e-a5ac-43dba2501fa3\") "
Nov 03 05:56:30.749816 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749565    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-metrics-client-ca" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:30.749816 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749695    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-trusted-ca-bundle" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:30.750067 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749828    4418 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.750067 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.749847    4418 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42de6f37-ac3f-454e-a5ac-43dba2501fa3-metrics-client-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.750067 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.750003    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-main-db" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:56:30.752015 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.751989    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-main-tls" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:30.752273 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.752239    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-metric" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:30.752774 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.752750    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-out" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:56:30.752883 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.752828    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-web" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:30.753019 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.752996    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-kube-api-access-lj26c" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "kube-api-access-lj26c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 05:56:30.753097 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.753040    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:30.753463 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.753448    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-tls-assets" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 05:56:30.753551 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.753518    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-volume" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:30.757956 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.757935    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-cluster-tls-config" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:30.766662 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.766635    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-web-config" pod "42de6f37-ac3f-454e-a5ac-43dba2501fa3" (UID: "42de6f37-ac3f-454e-a5ac-43dba2501fa3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:30.781728 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.781698    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7554212c-f391-4076-9e3d-a4f0a813d4f5" path="/var/lib/kubelet/pods/7554212c-f391-4076-9e3d-a4f0a813d4f5/volumes"
Nov 03 05:56:30.851323 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851286    4418 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-volume\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851323 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851320    4418 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-tls-assets\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851335    4418 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-alertmanager-main-db\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851356    4418 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851369    4418 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/42de6f37-ac3f-454e-a5ac-43dba2501fa3-config-out\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851382    4418 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-cluster-tls-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851394    4418 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-main-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851408    4418 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851427    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj26c\" (UniqueName: \"kubernetes.io/projected/42de6f37-ac3f-454e-a5ac-43dba2501fa3-kube-api-access-lj26c\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851442    4418 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:30.851545 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:30.851456    4418 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/42de6f37-ac3f-454e-a5ac-43dba2501fa3-web-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:31.180480 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.180449    4418 generic.go:356] "Generic (PLEG): container finished" podID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerID="13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172" exitCode=0
Nov 03 05:56:31.180480 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.180475    4418 generic.go:356] "Generic (PLEG): container finished" podID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerID="3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19" exitCode=0
Nov 03 05:56:31.180698 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.180497    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"}
Nov 03 05:56:31.180698 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.180551    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 05:56:31.180698 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.180569    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"}
Nov 03 05:56:31.180698 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.180598    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"42de6f37-ac3f-454e-a5ac-43dba2501fa3","Type":"ContainerDied","Data":"24fd16f8df739c989cdb65d2ca07a8dd8eb5f9a8af49f11d856e2862764228e5"}
Nov 03 05:56:31.180698 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.180633    4418 scope.go:122] "RemoveContainer" containerID="41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"
Nov 03 05:56:31.187888 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.187870    4418 scope.go:122] "RemoveContainer" containerID="13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"
Nov 03 05:56:31.195084 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.195063    4418 scope.go:122] "RemoveContainer" containerID="d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"
Nov 03 05:56:31.206364 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.206338    4418 scope.go:122] "RemoveContainer" containerID="3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"
Nov 03 05:56:31.212816 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.212794    4418 scope.go:122] "RemoveContainer" containerID="b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"
Nov 03 05:56:31.219207 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.219190    4418 scope.go:122] "RemoveContainer" containerID="5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"
Nov 03 05:56:31.225818 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.225795    4418 scope.go:122] "RemoveContainer" containerID="49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f"
Nov 03 05:56:31.232331 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.232299    4418 scope.go:122] "RemoveContainer" containerID="41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"
Nov 03 05:56:31.232698 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:31.232675    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605\": container with ID starting with 41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605 not found: ID does not exist" containerID="41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"
Nov 03 05:56:31.232761 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.232705    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"} err="failed to get container status \"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605\": rpc error: code = NotFound desc = could not find container \"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605\": container with ID starting with 41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605 not found: ID does not exist"
Nov 03 05:56:31.232761 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.232726    4418 scope.go:122] "RemoveContainer" containerID="13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"
Nov 03 05:56:31.233023 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:31.233009    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172\": container with ID starting with 13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172 not found: ID does not exist" containerID="13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"
Nov 03 05:56:31.233077 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233028    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"} err="failed to get container status \"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172\": rpc error: code = NotFound desc = could not find container \"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172\": container with ID starting with 13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172 not found: ID does not exist"
Nov 03 05:56:31.233077 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233043    4418 scope.go:122] "RemoveContainer" containerID="d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"
Nov 03 05:56:31.233293 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:31.233276    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123\": container with ID starting with d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123 not found: ID does not exist" containerID="d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"
Nov 03 05:56:31.233364 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233300    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"} err="failed to get container status \"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123\": rpc error: code = NotFound desc = could not find container \"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123\": container with ID starting with d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123 not found: ID does not exist"
Nov 03 05:56:31.233364 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233317    4418 scope.go:122] "RemoveContainer" containerID="3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"
Nov 03 05:56:31.233591 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:31.233573    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19\": container with ID starting with 3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19 not found: ID does not exist" containerID="3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"
Nov 03 05:56:31.233664 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233598    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"} err="failed to get container status \"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19\": rpc error: code = NotFound desc = could not find container \"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19\": container with ID starting with 3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19 not found: ID does not exist"
Nov 03 05:56:31.233664 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233617    4418 scope.go:122] "RemoveContainer" containerID="b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"
Nov 03 05:56:31.233869 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:31.233853    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4\": container with ID starting with b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4 not found: ID does not exist" containerID="b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"
Nov 03 05:56:31.233937 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233885    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"} err="failed to get container status \"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4\": rpc error: code = NotFound desc = could not find container \"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4\": container with ID starting with b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4 not found: ID does not exist"
Nov 03 05:56:31.233937 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.233904    4418 scope.go:122] "RemoveContainer" containerID="5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"
Nov 03 05:56:31.234088 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.234068    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 05:56:31.234234 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:31.234216    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a\": container with ID starting with 5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a not found: ID does not exist" containerID="5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"
Nov 03 05:56:31.234308 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.234242    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"} err="failed to get container status \"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a\": rpc error: code = NotFound desc = could not find container \"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a\": container with ID starting with 5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a not found: ID does not exist"
Nov 03 05:56:31.234308 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.234268    4418 scope.go:122] "RemoveContainer" containerID="49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f"
Nov 03 05:56:31.234555 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:31.234538    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f\": container with ID starting with 49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f not found: ID does not exist" containerID="49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f"
Nov 03 05:56:31.234619 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.234563    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f"} err="failed to get container status \"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f\": rpc error: code = NotFound desc = could not find container \"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f\": container with ID starting with 49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f not found: ID does not exist"
Nov 03 05:56:31.234619 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.234577    4418 scope.go:122] "RemoveContainer" containerID="41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"
Nov 03 05:56:31.234812 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.234791    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605"} err="failed to get container status \"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605\": rpc error: code = NotFound desc = could not find container \"41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605\": container with ID starting with 41a61ab6c5a469ffdce269c3924baa8b09747f4524e4beb7ff9e079f4acca605 not found: ID does not exist"
Nov 03 05:56:31.234876 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.234813    4418 scope.go:122] "RemoveContainer" containerID="13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"
Nov 03 05:56:31.235027 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235009    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172"} err="failed to get container status \"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172\": rpc error: code = NotFound desc = could not find container \"13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172\": container with ID starting with 13b9ea94be0d4d7b9781eee46b3f36077c03bde95f3e1093ce0698e983c34172 not found: ID does not exist"
Nov 03 05:56:31.235088 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235027    4418 scope.go:122] "RemoveContainer" containerID="d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"
Nov 03 05:56:31.235296 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235279    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123"} err="failed to get container status \"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123\": rpc error: code = NotFound desc = could not find container \"d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123\": container with ID starting with d78b47adb4301f0287d8653420ef58190e247849c93780e41712f850186f4123 not found: ID does not exist"
Nov 03 05:56:31.235353 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235303    4418 scope.go:122] "RemoveContainer" containerID="3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"
Nov 03 05:56:31.235556 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235539    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19"} err="failed to get container status \"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19\": rpc error: code = NotFound desc = could not find container \"3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19\": container with ID starting with 3bdf2dc7eb590bcb13148527d0f7911c80cdd9462388241be0956e7c6d6fce19 not found: ID does not exist"
Nov 03 05:56:31.235596 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235556    4418 scope.go:122] "RemoveContainer" containerID="b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"
Nov 03 05:56:31.235799 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235781    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4"} err="failed to get container status \"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4\": rpc error: code = NotFound desc = could not find container \"b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4\": container with ID starting with b3c7f8bc9afed76e693832176e5ef09aef7b2f48a45dd2f067d6a92a159424d4 not found: ID does not exist"
Nov 03 05:56:31.235844 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.235801    4418 scope.go:122] "RemoveContainer" containerID="5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"
Nov 03 05:56:31.236046 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.236028    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a"} err="failed to get container status \"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a\": rpc error: code = NotFound desc = could not find container \"5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a\": container with ID starting with 5771b7abaf105cf6e67e66850caa1517ea403f61a64e0e753cf9fcf70a80967a not found: ID does not exist"
Nov 03 05:56:31.236114 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.236047    4418 scope.go:122] "RemoveContainer" containerID="49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f"
Nov 03 05:56:31.236270 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.236251    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f"} err="failed to get container status \"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f\": rpc error: code = NotFound desc = could not find container \"49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f\": container with ID starting with 49440296d8cdba6b3c6dd5c329e6be0ff7e3eba800ed101802b2f81f272aea0f not found: ID does not exist"
Nov 03 05:56:31.245688 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:31.245665    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 05:56:32.780761 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:32.780730    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" path="/var/lib/kubelet/pods/42de6f37-ac3f-454e-a5ac-43dba2501fa3/volumes"
Nov 03 05:56:33.990462 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:33.990433    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:34.030002 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.029970    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:56:34.030305 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.030279    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="prometheus" containerID="cri-o://258f2df84c35f79289883e6422573b49fc91f037fc80cb0898cc9a0756219afe" gracePeriod=600
Nov 03 05:56:34.030397 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.030305    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="thanos-sidecar" containerID="cri-o://46b768ccbe7d94b970c06a38589832fc8e08f7cb340c33266a62fb9af7128027" gracePeriod=600
Nov 03 05:56:34.030397 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.030329    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-thanos" containerID="cri-o://17a8dd58b98d2088defbbe3b563beccffb97d61fbeeb3f00e0ca5eec593d4a38" gracePeriod=600
Nov 03 05:56:34.030397 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.030373    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="config-reloader" containerID="cri-o://9ea5a5c86724fd307b9f8fd85fc7f22c0650104fc4e5128d43a40b3dc5ecf20a" gracePeriod=600
Nov 03 05:56:34.030595 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.030365    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-web" containerID="cri-o://dde44268de1be9cd6e3f94f62d82c09e7beb2aae6e0630967aa51a6be1a5e62f" gracePeriod=600
Nov 03 05:56:34.030595 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.030305    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy" containerID="cri-o://d0f9bd1220d62d3edc4a841332645c7ff31177c4f40683deca76bf3f69e24fa5" gracePeriod=600
Nov 03 05:56:34.191409 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.191370    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:34.197400 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197373    4418 generic.go:356] "Generic (PLEG): container finished" podID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerID="17a8dd58b98d2088defbbe3b563beccffb97d61fbeeb3f00e0ca5eec593d4a38" exitCode=0
Nov 03 05:56:34.197400 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197397    4418 generic.go:356] "Generic (PLEG): container finished" podID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerID="d0f9bd1220d62d3edc4a841332645c7ff31177c4f40683deca76bf3f69e24fa5" exitCode=0
Nov 03 05:56:34.197400 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197403    4418 generic.go:356] "Generic (PLEG): container finished" podID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerID="dde44268de1be9cd6e3f94f62d82c09e7beb2aae6e0630967aa51a6be1a5e62f" exitCode=0
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197411    4418 generic.go:356] "Generic (PLEG): container finished" podID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerID="46b768ccbe7d94b970c06a38589832fc8e08f7cb340c33266a62fb9af7128027" exitCode=0
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197417    4418 generic.go:356] "Generic (PLEG): container finished" podID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerID="9ea5a5c86724fd307b9f8fd85fc7f22c0650104fc4e5128d43a40b3dc5ecf20a" exitCode=0
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197423    4418 generic.go:356] "Generic (PLEG): container finished" podID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerID="258f2df84c35f79289883e6422573b49fc91f037fc80cb0898cc9a0756219afe" exitCode=0
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197440    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"17a8dd58b98d2088defbbe3b563beccffb97d61fbeeb3f00e0ca5eec593d4a38"}
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197527    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"d0f9bd1220d62d3edc4a841332645c7ff31177c4f40683deca76bf3f69e24fa5"}
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197560    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"dde44268de1be9cd6e3f94f62d82c09e7beb2aae6e0630967aa51a6be1a5e62f"}
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197584    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"46b768ccbe7d94b970c06a38589832fc8e08f7cb340c33266a62fb9af7128027"}
Nov 03 05:56:34.197616 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197608    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"9ea5a5c86724fd307b9f8fd85fc7f22c0650104fc4e5128d43a40b3dc5ecf20a"}
Nov 03 05:56:34.197886 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.197631    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"258f2df84c35f79289883e6422573b49fc91f037fc80cb0898cc9a0756219afe"}
Nov 03 05:56:34.296801 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.296775    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:34.377550 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377519    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-tls-assets\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-tls-assets\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.377777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377563    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-kube-rbac-proxy\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.377777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377586    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-2\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.377777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377610    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-grpc-tls\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.377777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377737    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-kubelet-serving-ca-bundle\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.377777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377774    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-1\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377803    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377838    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-kube-api-access-7kskj\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-kube-api-access-7kskj\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377869    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-trusted-ca-bundle\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377894    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-web-config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-web-config\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.377931    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-db\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378004    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-thanos-prometheus-http-client-file\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378023    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-2" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:34.378062 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378038    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-metrics-client-certs\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378073    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-config\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378104    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-0\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378147    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-metrics-client-ca\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378177    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-tls\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378212    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378243    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-serving-certs-ca-bundle\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378456 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378275    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-config-out\") pod \"d916d223-53a4-4d96-9bfd-aa70159d5f82\" (UID: \"d916d223-53a4-4d96-9bfd-aa70159d5f82\") "
Nov 03 05:56:34.378826 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378525    4418 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.379033 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.378988    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-kubelet-serving-ca-bundle" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:34.380780 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.379128    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-trusted-ca-bundle" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:34.380780 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.380082    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-1" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:34.380780 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.380109    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-serving-certs-ca-bundle" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:34.380780 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.380164    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-metrics-client-ca" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:34.380780 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.380419    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-0" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:56:34.380780 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.380605    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-db" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:56:34.382407 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.382355    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-tls-assets" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 05:56:34.382407 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.382353    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-grpc-tls" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.382846 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.382805    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-thanos-prometheus-http-client-file" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.383355 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.383311    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-metrics-client-certs" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.383355 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.383330    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-kube-api-access-7kskj" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "kube-api-access-7kskj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 05:56:34.383733 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.383688    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-kube-rbac-proxy-web" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.383847 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.383821    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-tls" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.384078 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.384052    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-kube-rbac-proxy" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.384161 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.384115    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-config" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.384582 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.384559    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-thanos-sidecar-tls" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.384719 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.384697    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-config-out" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:56:34.393209 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.393178    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-web-config" pod "d916d223-53a4-4d96-9bfd-aa70159d5f82" (UID: "d916d223-53a4-4d96-9bfd-aa70159d5f82"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:56:34.479833 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479800    4418 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.479833 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479827    4418 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-metrics-client-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.479833 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479838    4418 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479850    4418 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479859    4418 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-metrics-client-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479868    4418 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479879    4418 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479887    4418 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479895    4418 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-config-out\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479904    4418 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-tls-assets\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479911    4418 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-kube-rbac-proxy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479919    4418 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-grpc-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479927    4418 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479936    4418 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479945    4418 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479953    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kskj\" (UniqueName: \"kubernetes.io/projected/d916d223-53a4-4d96-9bfd-aa70159d5f82-kube-api-access-7kskj\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479961    4418 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479969    4418 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d916d223-53a4-4d96-9bfd-aa70159d5f82-web-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:34.480055 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:34.479977    4418 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d916d223-53a4-4d96-9bfd-aa70159d5f82-prometheus-k8s-db\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:56:35.203977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.203942    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d916d223-53a4-4d96-9bfd-aa70159d5f82","Type":"ContainerDied","Data":"267c85e7adc19855264eead097c1ad0eea70f176eaed6981f47a3cd3bd981211"}
Nov 03 05:56:35.204348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.203991    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.204348 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.204018    4418 scope.go:122] "RemoveContainer" containerID="17a8dd58b98d2088defbbe3b563beccffb97d61fbeeb3f00e0ca5eec593d4a38"
Nov 03 05:56:35.211206 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.211188    4418 scope.go:122] "RemoveContainer" containerID="d0f9bd1220d62d3edc4a841332645c7ff31177c4f40683deca76bf3f69e24fa5"
Nov 03 05:56:35.217781 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.217763    4418 scope.go:122] "RemoveContainer" containerID="dde44268de1be9cd6e3f94f62d82c09e7beb2aae6e0630967aa51a6be1a5e62f"
Nov 03 05:56:35.224074 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.224060    4418 scope.go:122] "RemoveContainer" containerID="46b768ccbe7d94b970c06a38589832fc8e08f7cb340c33266a62fb9af7128027"
Nov 03 05:56:35.232090 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.232073    4418 scope.go:122] "RemoveContainer" containerID="9ea5a5c86724fd307b9f8fd85fc7f22c0650104fc4e5128d43a40b3dc5ecf20a"
Nov 03 05:56:35.238512 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.238484    4418 scope.go:122] "RemoveContainer" containerID="258f2df84c35f79289883e6422573b49fc91f037fc80cb0898cc9a0756219afe"
Nov 03 05:56:35.245670 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.245429    4418 scope.go:122] "RemoveContainer" containerID="8a61c38855bc60e36ab3be580ac223bd1bdaecb23e3b5ae30f8f780621f95c60"
Nov 03 05:56:35.270681 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.270660    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:56:35.282599 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.282576    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:56:35.306370 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306350    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:56:35.306733 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306720    4418 cpu_manager.go:414] "containerMap: removing container" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="init-config-reloader"
Nov 03 05:56:35.306777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306735    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="init-config-reloader"
Nov 03 05:56:35.306777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306746    4418 cpu_manager.go:414] "containerMap: removing container" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="prometheus"
Nov 03 05:56:35.306777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306751    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="prometheus"
Nov 03 05:56:35.306777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306758    4418 cpu_manager.go:414] "containerMap: removing container" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="config-reloader"
Nov 03 05:56:35.306777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306763    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="config-reloader"
Nov 03 05:56:35.306777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306772    4418 cpu_manager.go:414] "containerMap: removing container" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="config-reloader"
Nov 03 05:56:35.306777 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306778    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="config-reloader"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306785    4418 cpu_manager.go:414] "containerMap: removing container" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="init-config-reloader"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306790    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="init-config-reloader"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306796    4418 cpu_manager.go:414] "containerMap: removing container" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-thanos"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306800    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-thanos"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306807    4418 cpu_manager.go:414] "containerMap: removing container" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="alertmanager"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306812    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="alertmanager"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306818    4418 cpu_manager.go:414] "containerMap: removing container" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306822    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306828    4418 cpu_manager.go:414] "containerMap: removing container" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="prom-label-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306831    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="prom-label-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306841    4418 cpu_manager.go:414] "containerMap: removing container" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-web"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306846    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-web"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306852    4418 cpu_manager.go:414] "containerMap: removing container" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-metric"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306857    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-metric"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306863    4418 cpu_manager.go:414] "containerMap: removing container" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="thanos-sidecar"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306867    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="thanos-sidecar"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306872    4418 cpu_manager.go:414] "containerMap: removing container" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306877    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306884    4418 cpu_manager.go:414] "containerMap: removing container" podUID="7554212c-f391-4076-9e3d-a4f0a813d4f5" containerName="console"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306888    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7554212c-f391-4076-9e3d-a4f0a813d4f5" containerName="console"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306894    4418 cpu_manager.go:414] "containerMap: removing container" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-web"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306898    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-web"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306941    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="config-reloader"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306948    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-thanos"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306953    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="alertmanager"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306958    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306965    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="prom-label-proxy"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306975    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-web"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306983    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="42de6f37-ac3f-454e-a5ac-43dba2501fa3" containerName="kube-rbac-proxy-metric"
Nov 03 05:56:35.306977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306990    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="thanos-sidecar"
Nov 03 05:56:35.307980 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.306997    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy"
Nov 03 05:56:35.307980 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.307004    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="7554212c-f391-4076-9e3d-a4f0a813d4f5" containerName="console"
Nov 03 05:56:35.307980 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.307011    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="kube-rbac-proxy-web"
Nov 03 05:56:35.307980 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.307021    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="prometheus"
Nov 03 05:56:35.307980 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.307028    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" containerName="config-reloader"
Nov 03 05:56:35.332937 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.332895    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.342051 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.341285    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:56:35.350194 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.350162    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 03 05:56:35.350194 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.350176    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 03 05:56:35.350416 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.350400    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 03 05:56:35.350815 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.350779    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 03 05:56:35.350926 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.350822    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 03 05:56:35.350926 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.350824    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 03 05:56:35.350926 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.350834    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 03 05:56:35.351824 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.351807    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 03 05:56:35.351893 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.351816    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 03 05:56:35.351893 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.351886    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 03 05:56:35.351971 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.351936    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 03 05:56:35.361677 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.361660    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7lcm6\""
Nov 03 05:56:35.361677 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.361661    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 03 05:56:35.361857 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.361840    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6rbj7htbtaqvq\""
Nov 03 05:56:35.363128 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.363110    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 03 05:56:35.363204 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.363128    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 03 05:56:35.486051 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486024    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-web-config\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486051 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486052    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486228 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486073    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486228 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486090    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47359278-ce5c-41b9-a405-6fb4dd957b08-config-out\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486228 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486105    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457rs\" (UniqueName: \"kubernetes.io/projected/47359278-ce5c-41b9-a405-6fb4dd957b08-kube-api-access-457rs\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486332 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486233    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486332 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486267    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486332 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486288    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486332 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486309    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486534 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486379    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486534 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486444    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486534 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486470    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486534 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486490    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486713 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486565    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486713 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486586    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486713 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486658    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47359278-ce5c-41b9-a405-6fb4dd957b08-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486862 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486711    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486862 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486739    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-config\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486862 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486769    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.486862 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.486801    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587364 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587310    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587364 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587341    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-config\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587364 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587357    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587374    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587394    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-web-config\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587415    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587446    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587468    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47359278-ce5c-41b9-a405-6fb4dd957b08-config-out\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587490    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457rs\" (UniqueName: \"kubernetes.io/projected/47359278-ce5c-41b9-a405-6fb4dd957b08-kube-api-access-457rs\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587538    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587587 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587573    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587608    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587638    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587665    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587702    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587728    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587754    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587788    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587828    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.587952 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.587857    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47359278-ce5c-41b9-a405-6fb4dd957b08-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.588396 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.588167    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.588396 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.588270    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.588396 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.588375    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.589067 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.589039    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.590915 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.590883    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.591040 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.590888    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.591555 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.591254    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47359278-ce5c-41b9-a405-6fb4dd957b08-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.591555 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.591493    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.591749 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.591708    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.591806 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.591733    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.592918 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.592899    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-config\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.593028 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.592995    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-web-config\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.593228 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.593210    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.593314 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.593249    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.593431 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.593414    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47359278-ce5c-41b9-a405-6fb4dd957b08-config-out\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.593571 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.593549    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.593683 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.593667    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47359278-ce5c-41b9-a405-6fb4dd957b08-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.593900 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.593881    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.594453 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.594437    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47359278-ce5c-41b9-a405-6fb4dd957b08-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.612468 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.612448    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-457rs\" (UniqueName: \"kubernetes.io/projected/47359278-ce5c-41b9-a405-6fb4dd957b08-kube-api-access-457rs\") pod \"prometheus-k8s-0\" (UID: \"47359278-ce5c-41b9-a405-6fb4dd957b08\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:35.749394 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:35.749371    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:36.109311 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:36.109289    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 05:56:36.111928 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:56:36.111900    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47359278_ce5c_41b9_a405_6fb4dd957b08.slice/crio-d16fe93442533275ff0dd8267d53c71c467340e50b6ab6f3d7b3c43e475dbedb WatchSource:0}: Error finding container d16fe93442533275ff0dd8267d53c71c467340e50b6ab6f3d7b3c43e475dbedb: Status 404 returned error can't find the container with id d16fe93442533275ff0dd8267d53c71c467340e50b6ab6f3d7b3c43e475dbedb
Nov 03 05:56:36.199748 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:36.199723    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b765474f4-hdt7x"]
Nov 03 05:56:36.209567 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:36.209535    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerStarted","Data":"d16fe93442533275ff0dd8267d53c71c467340e50b6ab6f3d7b3c43e475dbedb"}
Nov 03 05:56:36.780582 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:36.780554    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d916d223-53a4-4d96-9bfd-aa70159d5f82" path="/var/lib/kubelet/pods/d916d223-53a4-4d96-9bfd-aa70159d5f82/volumes"
Nov 03 05:56:37.215379 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:37.215346    4418 generic.go:356] "Generic (PLEG): container finished" podID="47359278-ce5c-41b9-a405-6fb4dd957b08" containerID="2838ac9d43a51d1b25b8aa254ed05874b6e6874a26166c6517a317ba64f1ffc1" exitCode=0
Nov 03 05:56:37.215785 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:37.215413    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerDied","Data":"2838ac9d43a51d1b25b8aa254ed05874b6e6874a26166c6517a317ba64f1ffc1"}
Nov 03 05:56:38.222736 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:38.222699    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerStarted","Data":"c757d624f834b0218a73d4755102de363f8af6213949f656eb9b9973298927fb"}
Nov 03 05:56:38.223111 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:38.222777    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerStarted","Data":"d01d672cae9ed48ef41286c81752ea59313baf4f0ebaf460c73c6a55b28d9a7a"}
Nov 03 05:56:38.223111 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:38.222828    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerStarted","Data":"10b4588354d2e34a32d0b916b472d9c1d685bd99472b0bf4a1bfb72b84c83ac0"}
Nov 03 05:56:38.223111 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:38.222864    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerStarted","Data":"a475f127df42a066a43b516b809cefbac7f15731131f55d530882905d682a001"}
Nov 03 05:56:38.223111 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:38.222901    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerStarted","Data":"084bbc9fa0f37ff850800bbff1256abaa43d15fa2fb2c16e40089c325b0961c5"}
Nov 03 05:56:38.223111 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:38.222934    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47359278-ce5c-41b9-a405-6fb4dd957b08","Type":"ContainerStarted","Data":"e67ff967db0d09a9f3680113a98bf9c4a4ec633ab4ca3eed8ff596d9e0f301a3"}
Nov 03 05:56:38.290040 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:38.289985    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.261777994 podStartE2EDuration="3.289967676s" totalImagesPullingTime="0s" totalInitContainerRuntime="28.189682ms" isStatefulPod=false podCreationTimestamp="2026-11-03 05:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:56:38.289142915 +0000 UTC m=+85.659093002" watchObservedRunningTime="2026-11-03 05:56:38.289967676 +0000 UTC m=+85.659917761"
Nov 03 05:56:40.750092 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:40.750044    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:56:43.381604 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:43.381574    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:43.552207 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:43.552175    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:58.403131 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:56:58.403096    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:56:58.983610 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:58.983572    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:56:59.156347 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:56:59.156306    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:57:01.224799 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.224764    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-b765474f4-hdt7x" podUID="ade388d6-ed69-4995-8dce-43fa638140bc" containerName="console" containerID="cri-o://8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e" gracePeriod=15
Nov 03 05:57:01.472180 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.472158    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:57:01.491148 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491097    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-oauth-serving-cert\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491148 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491140    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-oauth-config\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491309 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491182    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ade388d6-ed69-4995-8dce-43fa638140bc-kube-api-access-h8bb6\" (UniqueName: \"kubernetes.io/projected/ade388d6-ed69-4995-8dce-43fa638140bc-kube-api-access-h8bb6\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491309 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491208    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-console-config\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-console-config\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491309 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491242    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-trusted-ca-bundle\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491482 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491394    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-serving-cert\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491482 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491445    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ade388d6-ed69-4995-8dce-43fa638140bc-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade388d6-ed69-4995-8dce-43fa638140bc-tmp\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491482 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491473    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-service-ca\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-service-ca\") pod \"ade388d6-ed69-4995-8dce-43fa638140bc\" (UID: \"ade388d6-ed69-4995-8dce-43fa638140bc\") "
Nov 03 05:57:01.491653 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491582    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-oauth-serving-cert" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:57:01.491709 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491662    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-trusted-ca-bundle" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:57:01.491709 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491680    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-console-config" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:57:01.491878 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491804    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade388d6-ed69-4995-8dce-43fa638140bc-tmp" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:57:01.491878 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491864    4418 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-oauth-serving-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:01.491994 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491885    4418 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-console-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:01.491994 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491900    4418 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-trusted-ca-bundle\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:01.491994 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.491900    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-service-ca" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 05:57:01.493325 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.493304    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-oauth-config" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:57:01.493496 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.493470    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-serving-cert" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 05:57:01.493662 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.493568    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade388d6-ed69-4995-8dce-43fa638140bc-kube-api-access-h8bb6" pod "ade388d6-ed69-4995-8dce-43fa638140bc" (UID: "ade388d6-ed69-4995-8dce-43fa638140bc"). InnerVolumeSpecName "kube-api-access-h8bb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 05:57:01.593254 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.593226    4418 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-oauth-config\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:01.593254 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.593253    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8bb6\" (UniqueName: \"kubernetes.io/projected/ade388d6-ed69-4995-8dce-43fa638140bc-kube-api-access-h8bb6\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:01.593449 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.593266    4418 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ade388d6-ed69-4995-8dce-43fa638140bc-console-serving-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:01.593449 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.593277    4418 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ade388d6-ed69-4995-8dce-43fa638140bc-tmp\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:01.593449 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:01.593291    4418 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ade388d6-ed69-4995-8dce-43fa638140bc-service-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:57:02.315859 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.315823    4418 generic.go:356] "Generic (PLEG): container finished" podID="ade388d6-ed69-4995-8dce-43fa638140bc" containerID="8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e" exitCode=0
Nov 03 05:57:02.316287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.315868    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b765474f4-hdt7x"
Nov 03 05:57:02.316287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.315891    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b765474f4-hdt7x" event={"ID":"ade388d6-ed69-4995-8dce-43fa638140bc","Type":"ContainerDied","Data":"8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e"}
Nov 03 05:57:02.316287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.315932    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b765474f4-hdt7x" event={"ID":"ade388d6-ed69-4995-8dce-43fa638140bc","Type":"ContainerDied","Data":"b26fdf66c01c684c5588ebebe0d862145e55ed17d229f2a34983d0f9d26c9eb1"}
Nov 03 05:57:02.316287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.315950    4418 scope.go:122] "RemoveContainer" containerID="8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e"
Nov 03 05:57:02.324173 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.324154    4418 scope.go:122] "RemoveContainer" containerID="8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e"
Nov 03 05:57:02.324437 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:57:02.324417    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e\": container with ID starting with 8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e not found: ID does not exist" containerID="8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e"
Nov 03 05:57:02.324490 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.324446    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e"} err="failed to get container status \"8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e\": rpc error: code = NotFound desc = could not find container \"8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e\": container with ID starting with 8cd2b8541402135e50a18da0612215d37c1762bc3c9bb9581fd33baea2b9e39e not found: ID does not exist"
Nov 03 05:57:02.366116 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.366097    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b765474f4-hdt7x"]
Nov 03 05:57:02.377820 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.377797    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b765474f4-hdt7x"]
Nov 03 05:57:02.780910 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:02.780877    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ade388d6-ed69-4995-8dce-43fa638140bc" path="/var/lib/kubelet/pods/ade388d6-ed69-4995-8dce-43fa638140bc/volumes"
Nov 03 05:57:03.189907 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:03.189876    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:57:28.403185 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:57:28.402971    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:57:34.702353 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:34.702313    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:57:34.865361 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:34.865328    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:57:35.749901 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:35.749874    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:57:35.763941 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:35.763920    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:57:36.454492 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:57:36.454466    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 05:57:58.402447 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:57:58.402410    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:58:00.951047 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:00.951012    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:01.114128 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:01.114092    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:03.321455 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:03.321410    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:14.783163 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:14.783125    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:15.008709 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:15.008671    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:15.180809 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:15.180777    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:16.307830 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:16.307788    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:16.483724 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:16.483694    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:17.604282 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:17.604250    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:23.820550 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:23.820491    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:23.988578 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:23.988543    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:25.065844 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.065807    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:25.235975 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.235942    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"]
Nov 03 05:58:25.236293 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.236276    4418 cpu_manager.go:414] "containerMap: removing container" podUID="ade388d6-ed69-4995-8dce-43fa638140bc" containerName="console"
Nov 03 05:58:25.236371 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.236295    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ade388d6-ed69-4995-8dce-43fa638140bc" containerName="console"
Nov 03 05:58:25.236428 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.236391    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="ade388d6-ed69-4995-8dce-43fa638140bc" containerName="console"
Nov 03 05:58:25.239480 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.239459    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.254663 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.254637    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:25.265887 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.265870    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-7wgkq\""
Nov 03 05:58:25.265887 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.265882    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 03 05:58:25.265887 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.265875    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 03 05:58:25.267000 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.266979    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"]
Nov 03 05:58:25.397696 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.397671    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.397843 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.397704    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcklk\" (UniqueName: \"kubernetes.io/projected/2a9d3579-eea8-4552-adaf-651269c805fc-kube-api-access-zcklk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.397843 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.397725    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.498259 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.498226    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.498385 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.498271    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcklk\" (UniqueName: \"kubernetes.io/projected/2a9d3579-eea8-4552-adaf-651269c805fc-kube-api-access-zcklk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.498385 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.498300    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.498631 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.498612    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.498709 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.498689    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.521254 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.521227    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcklk\" (UniqueName: \"kubernetes.io/projected/2a9d3579-eea8-4552-adaf-651269c805fc-kube-api-access-zcklk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.554484 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.554462    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:25.847730 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:25.847662    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"]
Nov 03 05:58:25.851082 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:58:25.851057    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9d3579_eea8_4552_adaf_651269c805fc.slice/crio-6eb4aafdb05cec2fe77cbff84e8a52a5f2333dc55d5b3d6b8719538a2db59d4f WatchSource:0}: Error finding container 6eb4aafdb05cec2fe77cbff84e8a52a5f2333dc55d5b3d6b8719538a2db59d4f: Status 404 returned error can't find the container with id 6eb4aafdb05cec2fe77cbff84e8a52a5f2333dc55d5b3d6b8719538a2db59d4f
Nov 03 05:58:26.611791 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:26.611745    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r" event={"ID":"2a9d3579-eea8-4552-adaf-651269c805fc","Type":"ContainerStarted","Data":"6eb4aafdb05cec2fe77cbff84e8a52a5f2333dc55d5b3d6b8719538a2db59d4f"}
Nov 03 05:58:28.325276 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:28.325235    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:28.408112 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:58:28.408073    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:58:31.632668 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:31.632631    4418 generic.go:356] "Generic (PLEG): container finished" podID="2a9d3579-eea8-4552-adaf-651269c805fc" containerID="21e875d9d04f1473c99e409c4cbea9a2554635f0e7f452d35f19c42b7dd94c7f" exitCode=0
Nov 03 05:58:31.633086 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:31.632695    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r" event={"ID":"2a9d3579-eea8-4552-adaf-651269c805fc","Type":"ContainerDied","Data":"21e875d9d04f1473c99e409c4cbea9a2554635f0e7f452d35f19c42b7dd94c7f"}
Nov 03 05:58:33.642356 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:33.642319    4418 generic.go:356] "Generic (PLEG): container finished" podID="2a9d3579-eea8-4552-adaf-651269c805fc" containerID="35cf8b37b2519df5f350c83305a4468143f647cc1d92fadca263ffb66fe2a229" exitCode=0
Nov 03 05:58:33.642758 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:33.642406    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r" event={"ID":"2a9d3579-eea8-4552-adaf-651269c805fc","Type":"ContainerDied","Data":"35cf8b37b2519df5f350c83305a4468143f647cc1d92fadca263ffb66fe2a229"}
Nov 03 05:58:34.522223 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:34.522188    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:34.685409 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:34.685367    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:39.667887 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:39.667855    4418 generic.go:356] "Generic (PLEG): container finished" podID="2a9d3579-eea8-4552-adaf-651269c805fc" containerID="c9bdf35156e71cfa6ea1e6f6baf86c06564233aa9fa056087649686696c6b863" exitCode=0
Nov 03 05:58:39.668286 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:39.667919    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r" event={"ID":"2a9d3579-eea8-4552-adaf-651269c805fc","Type":"ContainerDied","Data":"c9bdf35156e71cfa6ea1e6f6baf86c06564233aa9fa056087649686696c6b863"}
Nov 03 05:58:40.791454 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.791431    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:40.825686 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.825662    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-bundle\") pod \"2a9d3579-eea8-4552-adaf-651269c805fc\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") "
Nov 03 05:58:40.825797 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.825711    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a9d3579-eea8-4552-adaf-651269c805fc-kube-api-access-zcklk\" (UniqueName: \"kubernetes.io/projected/2a9d3579-eea8-4552-adaf-651269c805fc-kube-api-access-zcklk\") pod \"2a9d3579-eea8-4552-adaf-651269c805fc\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") "
Nov 03 05:58:40.825797 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.825751    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-util\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-util\") pod \"2a9d3579-eea8-4552-adaf-651269c805fc\" (UID: \"2a9d3579-eea8-4552-adaf-651269c805fc\") "
Nov 03 05:58:40.826286 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.826263    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-bundle" pod "2a9d3579-eea8-4552-adaf-651269c805fc" (UID: "2a9d3579-eea8-4552-adaf-651269c805fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:58:40.827977 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.827949    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9d3579-eea8-4552-adaf-651269c805fc-kube-api-access-zcklk" pod "2a9d3579-eea8-4552-adaf-651269c805fc" (UID: "2a9d3579-eea8-4552-adaf-651269c805fc"). InnerVolumeSpecName "kube-api-access-zcklk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 05:58:40.830132 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.830101    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-util" pod "2a9d3579-eea8-4552-adaf-651269c805fc" (UID: "2a9d3579-eea8-4552-adaf-651269c805fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 05:58:40.926541 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.926450    4418 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-util\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:58:40.926541 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.926477    4418 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9d3579-eea8-4552-adaf-651269c805fc-bundle\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:58:40.926541 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:40.926487    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcklk\" (UniqueName: \"kubernetes.io/projected/2a9d3579-eea8-4552-adaf-651269c805fc-kube-api-access-zcklk\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 05:58:41.675910 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:41.675885    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r"
Nov 03 05:58:41.676070 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:41.675877    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847axzr7r" event={"ID":"2a9d3579-eea8-4552-adaf-651269c805fc","Type":"ContainerDied","Data":"6eb4aafdb05cec2fe77cbff84e8a52a5f2333dc55d5b3d6b8719538a2db59d4f"}
Nov 03 05:58:41.676070 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:41.676003    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6eb4aafdb05cec2fe77cbff84e8a52a5f2333dc55d5b3d6b8719538a2db59d4f"
Nov 03 05:58:43.905796 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:58:43.905761    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:58:58.403487 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:58:58.403413    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:59:03.458746 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:03.458710    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:05.324369 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:05.324334    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:05.504249 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:05.504210    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:06.020446 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.020358    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:06.155570 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155538    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"]
Nov 03 05:59:06.155832 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155821    4418 cpu_manager.go:414] "containerMap: removing container" podUID="2a9d3579-eea8-4552-adaf-651269c805fc" containerName="util"
Nov 03 05:59:06.155890 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155834    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a9d3579-eea8-4552-adaf-651269c805fc" containerName="util"
Nov 03 05:59:06.155890 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155855    4418 cpu_manager.go:414] "containerMap: removing container" podUID="2a9d3579-eea8-4552-adaf-651269c805fc" containerName="pull"
Nov 03 05:59:06.155890 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155860    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a9d3579-eea8-4552-adaf-651269c805fc" containerName="pull"
Nov 03 05:59:06.155890 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155877    4418 cpu_manager.go:414] "containerMap: removing container" podUID="2a9d3579-eea8-4552-adaf-651269c805fc" containerName="extract"
Nov 03 05:59:06.155890 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155881    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a9d3579-eea8-4552-adaf-651269c805fc" containerName="extract"
Nov 03 05:59:06.156043 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.155923    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a9d3579-eea8-4552-adaf-651269c805fc" containerName="extract"
Nov 03 05:59:06.158906 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.158888    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.209381 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.209352    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.209381 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.209383    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-metrics-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.209592 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.209401    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36987a88-f489-45d7-9535-825047f997c0-tmp\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.209592 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.209423    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf6m7\" (UniqueName: \"kubernetes.io/projected/36987a88-f489-45d7-9535-825047f997c0-kube-api-access-qf6m7\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.209592 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.209554    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.209697 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.209594    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36987a88-f489-45d7-9535-825047f997c0-manifests\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.221974 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.221948    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 03 05:59:06.222169 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.222151    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 03 05:59:06.222270 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.222257    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 03 05:59:06.222325 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.222270    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 03 05:59:06.222384 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.222370    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 03 05:59:06.222450 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.222440    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-5996c\""
Nov 03 05:59:06.229314 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.229289    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"]
Nov 03 05:59:06.310362 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.310276    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.310362 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.310317    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-metrics-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.310362 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.310341    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36987a88-f489-45d7-9535-825047f997c0-tmp\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.310362 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.310361    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf6m7\" (UniqueName: \"kubernetes.io/projected/36987a88-f489-45d7-9535-825047f997c0-kube-api-access-qf6m7\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.310728 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.310389    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.310728 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.310415    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36987a88-f489-45d7-9535-825047f997c0-manifests\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.310837 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.310814    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36987a88-f489-45d7-9535-825047f997c0-manifests\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.312680 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.312659    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36987a88-f489-45d7-9535-825047f997c0-tmp\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.312929 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.312912    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.313009 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.312994    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.313077 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.313058    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36987a88-f489-45d7-9535-825047f997c0-metrics-cert\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.337417 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.337395    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf6m7\" (UniqueName: \"kubernetes.io/projected/36987a88-f489-45d7-9535-825047f997c0-kube-api-access-qf6m7\") pod \"opendatahub-operator-controller-manager-54b885cf97-7s9ld\" (UID: \"36987a88-f489-45d7-9535-825047f997c0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.362852 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.362826    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:06.474292 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.474259    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:06.523182 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.523139    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:06.689941 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.689907    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:06.831043 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:06.831010    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"]
Nov 03 05:59:06.833967 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:59:06.833945    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36987a88_f489_45d7_9535_825047f997c0.slice/crio-df2f41976d69db5bc514a3902a2388194e430dad3a1fff29902c2135ee4b7447 WatchSource:0}: Error finding container df2f41976d69db5bc514a3902a2388194e430dad3a1fff29902c2135ee4b7447: Status 404 returned error can't find the container with id df2f41976d69db5bc514a3902a2388194e430dad3a1fff29902c2135ee4b7447
Nov 03 05:59:07.551827 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:07.551770    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:07.770670 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:07.770630    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld" event={"ID":"36987a88-f489-45d7-9535-825047f997c0","Type":"ContainerStarted","Data":"df2f41976d69db5bc514a3902a2388194e430dad3a1fff29902c2135ee4b7447"}
Nov 03 05:59:09.144166 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:09.144125    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:09.342129 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:09.342093    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:09.713519 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:09.713470    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:09.781986 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:09.781902    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld" event={"ID":"36987a88-f489-45d7-9535-825047f997c0","Type":"ContainerStarted","Data":"f4d97a7981a1e14370aa8bcddd95bab123ed1fa1038a428b0972099c076d4bfd"}
Nov 03 05:59:10.786458 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:10.786427    4418 generic.go:356] "Generic (PLEG): container finished" podID="36987a88-f489-45d7-9535-825047f997c0" containerID="f4d97a7981a1e14370aa8bcddd95bab123ed1fa1038a428b0972099c076d4bfd" exitCode=0
Nov 03 05:59:10.786458 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:10.786458    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld" event={"ID":"36987a88-f489-45d7-9535-825047f997c0","Type":"ContainerDied","Data":"f4d97a7981a1e14370aa8bcddd95bab123ed1fa1038a428b0972099c076d4bfd"}
Nov 03 05:59:11.791986 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:11.791949    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld" event={"ID":"36987a88-f489-45d7-9535-825047f997c0","Type":"ContainerStarted","Data":"5851ba806cc72d01fdfff8b1b20b90486261fdbff6db6457f2795bef813aa16b"}
Nov 03 05:59:11.792361 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:11.792086    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:11.889679 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:11.889628    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld" podStartSLOduration=2.406260651 podStartE2EDuration="5.889611315s" totalImagesPullingTime="2.986045519s" totalInitContainerRuntime="497.305145ms" isStatefulPod=false podCreationTimestamp="2026-11-03 05:59:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:59:11.877538496 +0000 UTC m=+239.247488579" watchObservedRunningTime="2026-11-03 05:59:11.889611315 +0000 UTC m=+239.259561396"
Nov 03 05:59:12.652077 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:12.652048    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:15.002401 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:15.002355    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:15.213009 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:15.212977    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:15.542945 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:15.542903    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:15.729358 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:15.729328    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:17.605825 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:17.605793    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:17.897774 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:17.897747    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:18.598400 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.598371    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"]
Nov 03 05:59:18.604887 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.604868    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:18.620300 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.620283    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 03 05:59:18.632128 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.632108    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rbpst\""
Nov 03 05:59:18.633387 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.633371    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"]
Nov 03 05:59:18.658431 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.658406    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbkfx\" (UniqueName: \"kubernetes.io/projected/f1b1e79a-c2aa-4f64-8bfe-89a526defb5a-kube-api-access-bbkfx\") pod \"cert-manager-webhook-5dbbbf75cc-8jxd6\" (UID: \"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:18.658560 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.658463    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1b1e79a-c2aa-4f64-8bfe-89a526defb5a-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8jxd6\" (UID: \"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:18.721462 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.721441    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 03 05:59:18.759384 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.759361    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1b1e79a-c2aa-4f64-8bfe-89a526defb5a-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8jxd6\" (UID: \"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:18.759463 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.759400    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbkfx\" (UniqueName: \"kubernetes.io/projected/f1b1e79a-c2aa-4f64-8bfe-89a526defb5a-kube-api-access-bbkfx\") pod \"cert-manager-webhook-5dbbbf75cc-8jxd6\" (UID: \"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:18.787110 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.787091    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1b1e79a-c2aa-4f64-8bfe-89a526defb5a-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-8jxd6\" (UID: \"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:18.787671 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.787654    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbkfx\" (UniqueName: \"kubernetes.io/projected/f1b1e79a-c2aa-4f64-8bfe-89a526defb5a-kube-api-access-bbkfx\") pod \"cert-manager-webhook-5dbbbf75cc-8jxd6\" (UID: \"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:18.927954 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:18.927930    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:19.220681 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:19.220606    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"]
Nov 03 05:59:19.224206 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:59:19.224178    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1b1e79a_c2aa_4f64_8bfe_89a526defb5a.slice/crio-6c324ff62ece86eec0d4e020ec31cc57c62ad1ea6c8ee8912fe4dd4639f6e2b5 WatchSource:0}: Error finding container 6c324ff62ece86eec0d4e020ec31cc57c62ad1ea6c8ee8912fe4dd4639f6e2b5: Status 404 returned error can't find the container with id 6c324ff62ece86eec0d4e020ec31cc57c62ad1ea6c8ee8912fe4dd4639f6e2b5
Nov 03 05:59:19.823942 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:19.823903    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6" event={"ID":"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a","Type":"ContainerStarted","Data":"6c324ff62ece86eec0d4e020ec31cc57c62ad1ea6c8ee8912fe4dd4639f6e2b5"}
Nov 03 05:59:20.006740 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:20.006688    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:20.168135 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:20.168098    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:21.678931 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:21.678879    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:21.856604 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:21.856560    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:22.797740 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:22.797713    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54b885cf97-7s9ld"
Nov 03 05:59:22.837000 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:22.836973    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6" event={"ID":"f1b1e79a-c2aa-4f64-8bfe-89a526defb5a","Type":"ContainerStarted","Data":"e31f71dde496799467246821871952b4ec39d337a4f68551341f68a709ff8195"}
Nov 03 05:59:22.837123 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:22.837047    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:22.969267 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:22.969219    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6" podStartSLOduration=2.149362648 podStartE2EDuration="4.969205792s" totalImagesPullingTime="2.819843144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:59:22.96773376 +0000 UTC m=+250.337683844" watchObservedRunningTime="2026-11-03 05:59:22.969205792 +0000 UTC m=+250.339155876"
Nov 03 05:59:24.615782 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:24.615747    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:24.834930 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:24.834899    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:25.153276 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.153245    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:25.457881 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.457812    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"]
Nov 03 05:59:25.461014 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.460995    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:25.482439 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.482413    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tsrfs\""
Nov 03 05:59:25.491853 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.491830    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"]
Nov 03 05:59:25.504216 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.504193    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvzxh\" (UniqueName: \"kubernetes.io/projected/92e3090c-e886-45c7-9ec0-bc0c98893e85-kube-api-access-cvzxh\") pod \"cert-manager-cainjector-5c57bbd4fc-4dgcd\" (UID: \"92e3090c-e886-45c7-9ec0-bc0c98893e85\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:25.504315 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.504234    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92e3090c-e886-45c7-9ec0-bc0c98893e85-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-4dgcd\" (UID: \"92e3090c-e886-45c7-9ec0-bc0c98893e85\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:25.605046 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.605022    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvzxh\" (UniqueName: \"kubernetes.io/projected/92e3090c-e886-45c7-9ec0-bc0c98893e85-kube-api-access-cvzxh\") pod \"cert-manager-cainjector-5c57bbd4fc-4dgcd\" (UID: \"92e3090c-e886-45c7-9ec0-bc0c98893e85\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:25.605152 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.605056    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92e3090c-e886-45c7-9ec0-bc0c98893e85-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-4dgcd\" (UID: \"92e3090c-e886-45c7-9ec0-bc0c98893e85\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:25.639083 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.639063    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92e3090c-e886-45c7-9ec0-bc0c98893e85-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-4dgcd\" (UID: \"92e3090c-e886-45c7-9ec0-bc0c98893e85\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:25.639447 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.639426    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvzxh\" (UniqueName: \"kubernetes.io/projected/92e3090c-e886-45c7-9ec0-bc0c98893e85-kube-api-access-cvzxh\") pod \"cert-manager-cainjector-5c57bbd4fc-4dgcd\" (UID: \"92e3090c-e886-45c7-9ec0-bc0c98893e85\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:25.771563 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:25.771488    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"
Nov 03 05:59:26.073633 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:26.073567    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd"]
Nov 03 05:59:26.076910 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:59:26.076888    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92e3090c_e886_45c7_9ec0_bc0c98893e85.slice/crio-561ed5ba207ecd8efc7fd78927a5f4aea77b4865a1fef15f243df903f1a1f17f WatchSource:0}: Error finding container 561ed5ba207ecd8efc7fd78927a5f4aea77b4865a1fef15f243df903f1a1f17f: Status 404 returned error can't find the container with id 561ed5ba207ecd8efc7fd78927a5f4aea77b4865a1fef15f243df903f1a1f17f
Nov 03 05:59:26.852832 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:26.852799    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd" event={"ID":"92e3090c-e886-45c7-9ec0-bc0c98893e85","Type":"ContainerStarted","Data":"31f813463999ac1c2ca8f57e5669e02dbf8dde4acce1143f87587e0c62e3a6c2"}
Nov 03 05:59:26.852832 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:26.852839    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd" event={"ID":"92e3090c-e886-45c7-9ec0-bc0c98893e85","Type":"ContainerStarted","Data":"561ed5ba207ecd8efc7fd78927a5f4aea77b4865a1fef15f243df903f1a1f17f"}
Nov 03 05:59:26.892838 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:26.892795    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-4dgcd" podStartSLOduration=1.892783273 podStartE2EDuration="1.892783273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:59:26.891635835 +0000 UTC m=+254.261585918" watchObservedRunningTime="2026-11-03 05:59:26.892783273 +0000 UTC m=+254.262733357"
Nov 03 05:59:27.163072 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:27.163041    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:27.341762 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:27.341720    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:27.796729 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:27.796696    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:28.403210 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:59:28.403165    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:59:28.842102 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:28.842034    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-8jxd6"
Nov 03 05:59:28.911380 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:28.911352    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:29.727081 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:29.727041    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:30.528368 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:30.528334    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:33.146364 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:33.146329    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:35.571212 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:35.571166    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:35.775672 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:35.775632    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:35.937513 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:35.937475    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:36.117272 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:36.117235    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:38.351727 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:38.351691    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:38.534264 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:38.534229    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:39.562119 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:39.562084    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:39.735481 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:39.735448    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:39.918533 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:39.918487    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:40.338955 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.338886    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"]
Nov 03 05:59:40.423118 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.423088    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"]
Nov 03 05:59:40.423273 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.423229    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.428131 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.428104    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:40.444013 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.443992    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 03 05:59:40.444119 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.444014    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 03 05:59:40.475899 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.475876    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 03 05:59:40.476011 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.475943    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 03 05:59:40.476011 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.475967    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6dhm6\""
Nov 03 05:59:40.525025 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.525002    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-tmp\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.525125 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.525030    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g9bs\" (UniqueName: \"kubernetes.io/projected/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-kube-api-access-8g9bs\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.525125 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.525075    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-tls-certs\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.626330 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.626309    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-tls-certs\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.626660 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.626349    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-tmp\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.626660 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.626366    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g9bs\" (UniqueName: \"kubernetes.io/projected/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-kube-api-access-8g9bs\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.628532 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.628515    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-tmp\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.628662 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.628645    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-tls-certs\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.666006 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.665978    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:40.670138 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.670120    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g9bs\" (UniqueName: \"kubernetes.io/projected/bbb40a89-211d-4d94-a4ca-ca1b7ebc1841-kube-api-access-8g9bs\") pod \"kube-auth-proxy-d95cd9746-vxcv5\" (UID: \"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841\") " pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.746615 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.746581    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"
Nov 03 05:59:40.854493 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:40.854461    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:41.020483 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.020415    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:41.084086 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.084062    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5"]
Nov 03 05:59:41.087126 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:59:41.087100    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb40a89_211d_4d94_a4ca_ca1b7ebc1841.slice/crio-0d71ae89fae5b5cf3704b025d7d8be3db3b1fa6beed4df52133c11e66493ea3a WatchSource:0}: Error finding container 0d71ae89fae5b5cf3704b025d7d8be3db3b1fa6beed4df52133c11e66493ea3a: Status 404 returned error can't find the container with id 0d71ae89fae5b5cf3704b025d7d8be3db3b1fa6beed4df52133c11e66493ea3a
Nov 03 05:59:41.884822 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.884781    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"]
Nov 03 05:59:41.888706 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.888683    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"
Nov 03 05:59:41.921065 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.920986    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5" event={"ID":"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841","Type":"ContainerStarted","Data":"0d71ae89fae5b5cf3704b025d7d8be3db3b1fa6beed4df52133c11e66493ea3a"}
Nov 03 05:59:41.923631 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.923590    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8hrfq\""
Nov 03 05:59:41.923759 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.923641    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 03 05:59:41.923759 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.923666    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 03 05:59:41.925761 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.925476    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"]
Nov 03 05:59:41.925971 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.925899    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:41.936584 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:41.936561    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh459\" (UniqueName: \"kubernetes.io/projected/27c75630-5e15-45f9-8f58-5031840eac08-kube-api-access-mh459\") pod \"limitador-operator-controller-manager-5778bb4449-h7j92\" (UID: \"27c75630-5e15-45f9-8f58-5031840eac08\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"
Nov 03 05:59:42.037961 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:42.037924    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh459\" (UniqueName: \"kubernetes.io/projected/27c75630-5e15-45f9-8f58-5031840eac08-kube-api-access-mh459\") pod \"limitador-operator-controller-manager-5778bb4449-h7j92\" (UID: \"27c75630-5e15-45f9-8f58-5031840eac08\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"
Nov 03 05:59:42.063577 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:42.063548    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh459\" (UniqueName: \"kubernetes.io/projected/27c75630-5e15-45f9-8f58-5031840eac08-kube-api-access-mh459\") pod \"limitador-operator-controller-manager-5778bb4449-h7j92\" (UID: \"27c75630-5e15-45f9-8f58-5031840eac08\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"
Nov 03 05:59:42.204797 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:42.204718    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"
Nov 03 05:59:42.511740 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:42.511675    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"]
Nov 03 05:59:42.514953 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:59:42.514924    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c75630_5e15_45f9_8f58_5031840eac08.slice/crio-c74df8ac8709fca2d74fcbd6db9e3cac56a08e4f67ed5a690aaecb76efab9881 WatchSource:0}: Error finding container c74df8ac8709fca2d74fcbd6db9e3cac56a08e4f67ed5a690aaecb76efab9881: Status 404 returned error can't find the container with id c74df8ac8709fca2d74fcbd6db9e3cac56a08e4f67ed5a690aaecb76efab9881
Nov 03 05:59:42.926529 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:42.926482    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92" event={"ID":"27c75630-5e15-45f9-8f58-5031840eac08","Type":"ContainerStarted","Data":"c74df8ac8709fca2d74fcbd6db9e3cac56a08e4f67ed5a690aaecb76efab9881"}
Nov 03 05:59:43.158415 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:43.158379    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:43.320287 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:43.319574    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:43.933307 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:43.933271    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5" event={"ID":"bbb40a89-211d-4d94-a4ca-ca1b7ebc1841","Type":"ContainerStarted","Data":"2e499e131227de25cb5f18317973b2b38b47a5fb62d427f1857f07fd65fdf087"}
Nov 03 05:59:43.976189 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:43.976141    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d95cd9746-vxcv5" podStartSLOduration=1.564635616 podStartE2EDuration="3.976126579s" totalImagesPullingTime="2.411490963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:59:43.974273662 +0000 UTC m=+271.344223748" watchObservedRunningTime="2026-11-03 05:59:43.976126579 +0000 UTC m=+271.346076662"
Nov 03 05:59:44.367655 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:44.367626    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:44.559104 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:44.559066    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:45.942857 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:45.942827    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92" event={"ID":"27c75630-5e15-45f9-8f58-5031840eac08","Type":"ContainerStarted","Data":"81243cdde9df42b537b2b9ff7fd4aea828093ae552a4f1a22f3be63d332aae88"}
Nov 03 05:59:45.943376 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:45.942887    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"
Nov 03 05:59:45.985654 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:45.985612    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92" podStartSLOduration=2.435143553 podStartE2EDuration="4.985600228s" totalImagesPullingTime="2.550456675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:59:45.984758694 +0000 UTC m=+273.354708778" watchObservedRunningTime="2026-11-03 05:59:45.985600228 +0000 UTC m=+273.355550311"
Nov 03 05:59:48.718467 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:48.718430    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:48.894157 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:48.894128    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:49.061996 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.061921    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:49.073178 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.073155    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"]
Nov 03 05:59:49.076808 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.076791    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.092003 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.091985    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-vd4v8\""
Nov 03 05:59:49.092649 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.092629    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 03 05:59:49.092871 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.092858    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 03 05:59:49.116513 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.116477    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Nov 03 05:59:49.117687 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.117670    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"]
Nov 03 05:59:49.195630 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.195605    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4111e193-18f7-46fb-a769-a516c78c2e13-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.195727 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.195655    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4kbv\" (UniqueName: \"kubernetes.io/projected/4111e193-18f7-46fb-a769-a516c78c2e13-kube-api-access-f4kbv\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.195727 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.195673    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4111e193-18f7-46fb-a769-a516c78c2e13-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.195799 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.195759    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4111e193-18f7-46fb-a769-a516c78c2e13-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.230595 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.230568    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:49.296217 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.296188    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4111e193-18f7-46fb-a769-a516c78c2e13-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.296329 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.296255    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4kbv\" (UniqueName: \"kubernetes.io/projected/4111e193-18f7-46fb-a769-a516c78c2e13-kube-api-access-f4kbv\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.296329 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.296283    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4111e193-18f7-46fb-a769-a516c78c2e13-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.296329 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.296307    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4111e193-18f7-46fb-a769-a516c78c2e13-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.296742 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.296721    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4111e193-18f7-46fb-a769-a516c78c2e13-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.296811 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.296772    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4111e193-18f7-46fb-a769-a516c78c2e13-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.297031 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.297014    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4111e193-18f7-46fb-a769-a516c78c2e13-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.319640 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.319590    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4kbv\" (UniqueName: \"kubernetes.io/projected/4111e193-18f7-46fb-a769-a516c78c2e13-kube-api-access-f4kbv\") pod \"kserve-module-controller-manager-7566cf5fc8-ntcx4\" (UID: \"4111e193-18f7-46fb-a769-a516c78c2e13\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.388901 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.388882    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:49.732183 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.732160    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"]
Nov 03 05:59:49.734650 ip-10-0-138-242 kubenswrapper[4418]: W1103 05:59:49.734619    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4111e193_18f7_46fb_a769_a516c78c2e13.slice/crio-c6e256582c845732fb29db738a8b7026e6216f1d8ad1b6bfd33105d2aaaa105b WatchSource:0}: Error finding container c6e256582c845732fb29db738a8b7026e6216f1d8ad1b6bfd33105d2aaaa105b: Status 404 returned error can't find the container with id c6e256582c845732fb29db738a8b7026e6216f1d8ad1b6bfd33105d2aaaa105b
Nov 03 05:59:49.958928 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:49.958898    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4" event={"ID":"4111e193-18f7-46fb-a769-a516c78c2e13","Type":"ContainerStarted","Data":"c6e256582c845732fb29db738a8b7026e6216f1d8ad1b6bfd33105d2aaaa105b"}
Nov 03 05:59:50.817725 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:50.817689    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:50.983166 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:50.983134    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:51.968614 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:51.968583    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4" event={"ID":"4111e193-18f7-46fb-a769-a516c78c2e13","Type":"ContainerStarted","Data":"eb3ac9acf247afcf06f0c2398b88c12c814d8b6cd7aefbf1952455777fc08f05"}
Nov 03 05:59:51.969000 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:51.968646    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 05:59:52.074913 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:52.074845    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4" podStartSLOduration=1.561070891 podStartE2EDuration="3.074833329s" totalImagesPullingTime="1.513762438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 05:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 05:59:52.07364024 +0000 UTC m=+279.443590337" watchObservedRunningTime="2026-11-03 05:59:52.074833329 +0000 UTC m=+279.444783413"
Nov 03 05:59:56.598197 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:56.598160    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:56.778198 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:56.778154    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:56.949031 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:56.949008    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-h7j92"
Nov 03 05:59:58.403245 ip-10-0-138-242 kubenswrapper[4418]: E1103 05:59:58.403208    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 05:59:59.604861 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:59.604820    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 05:59:59.777766 ip-10-0-138-242 kubenswrapper[4418]: I1103 05:59:59.777736    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:02.207966 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:02.207934    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:02.398064 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:02.398036    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:03.580618 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:03.580579    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:03.747907 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:03.747869    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:04.676583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.676551    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qm6zn"]
Nov 03 06:00:04.680004 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.679983    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qm6zn"
Nov 03 06:00:04.708746 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.708717    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pj47t\""
Nov 03 06:00:04.710195 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.710174    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qm6zn"]
Nov 03 06:00:04.807598 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.807564    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:04.832656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.832629    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ttcq\" (UniqueName: \"kubernetes.io/projected/da37b39a-f4c0-442f-bcf5-34ae76031b49-kube-api-access-5ttcq\") pod \"authorino-57f7f8659f-qm6zn\" (UID: \"da37b39a-f4c0-442f-bcf5-34ae76031b49\") " pod="kuadrant-system/authorino-57f7f8659f-qm6zn"
Nov 03 06:00:04.934015 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.933924    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ttcq\" (UniqueName: \"kubernetes.io/projected/da37b39a-f4c0-442f-bcf5-34ae76031b49-kube-api-access-5ttcq\") pod \"authorino-57f7f8659f-qm6zn\" (UID: \"da37b39a-f4c0-442f-bcf5-34ae76031b49\") " pod="kuadrant-system/authorino-57f7f8659f-qm6zn"
Nov 03 06:00:04.940426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.940399    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-rl66c"]
Nov 03 06:00:04.943916 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.943897    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:04.978079 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.978043    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 03 06:00:04.978317 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.978304    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qtbtg\""
Nov 03 06:00:04.981297 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.981272    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-rl66c"]
Nov 03 06:00:04.984876 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.984855    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ttcq\" (UniqueName: \"kubernetes.io/projected/da37b39a-f4c0-442f-bcf5-34ae76031b49-kube-api-access-5ttcq\") pod \"authorino-57f7f8659f-qm6zn\" (UID: \"da37b39a-f4c0-442f-bcf5-34ae76031b49\") " pod="kuadrant-system/authorino-57f7f8659f-qm6zn"
Nov 03 06:00:04.991366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:04.991340    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qm6zn"
Nov 03 06:00:05.014023 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.013986    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:05.034831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.034799    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92c16db0-9b31-4107-ab5c-4eb1d46d667a-config-file\") pod \"limitador-limitador-74dfcfb894-rl66c\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:05.034831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.034834    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s275x\" (UniqueName: \"kubernetes.io/projected/92c16db0-9b31-4107-ab5c-4eb1d46d667a-kube-api-access-s275x\") pod \"limitador-limitador-74dfcfb894-rl66c\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:05.066528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.066475    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-rl66c"]
Nov 03 06:00:05.135450 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.135414    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92c16db0-9b31-4107-ab5c-4eb1d46d667a-config-file\") pod \"limitador-limitador-74dfcfb894-rl66c\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:05.135450 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.135455    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s275x\" (UniqueName: \"kubernetes.io/projected/92c16db0-9b31-4107-ab5c-4eb1d46d667a-kube-api-access-s275x\") pod \"limitador-limitador-74dfcfb894-rl66c\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:05.136109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.136090    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92c16db0-9b31-4107-ab5c-4eb1d46d667a-config-file\") pod \"limitador-limitador-74dfcfb894-rl66c\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:05.158434 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.158411    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s275x\" (UniqueName: \"kubernetes.io/projected/92c16db0-9b31-4107-ab5c-4eb1d46d667a-kube-api-access-s275x\") pod \"limitador-limitador-74dfcfb894-rl66c\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:05.255860 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.255789    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:05.287928 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.287904    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qm6zn"]
Nov 03 06:00:05.290904 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:05.290878    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda37b39a_f4c0_442f_bcf5_34ae76031b49.slice/crio-fbf1ee21fe78cf648812e3ee649ccd52082c6df6abbe59888ffd47c4eebfd65e WatchSource:0}: Error finding container fbf1ee21fe78cf648812e3ee649ccd52082c6df6abbe59888ffd47c4eebfd65e: Status 404 returned error can't find the container with id fbf1ee21fe78cf648812e3ee649ccd52082c6df6abbe59888ffd47c4eebfd65e
Nov 03 06:00:05.563321 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:05.563124    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-rl66c"]
Nov 03 06:00:05.565961 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:05.565935    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c16db0_9b31_4107_ab5c_4eb1d46d667a.slice/crio-d75324e41563ac0482aba68e9e0d65534780caa0bf55c760347305343a63bd1d WatchSource:0}: Error finding container d75324e41563ac0482aba68e9e0d65534780caa0bf55c760347305343a63bd1d: Status 404 returned error can't find the container with id d75324e41563ac0482aba68e9e0d65534780caa0bf55c760347305343a63bd1d
Nov 03 06:00:06.027888 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:06.027853    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qm6zn" event={"ID":"da37b39a-f4c0-442f-bcf5-34ae76031b49","Type":"ContainerStarted","Data":"fbf1ee21fe78cf648812e3ee649ccd52082c6df6abbe59888ffd47c4eebfd65e"}
Nov 03 06:00:06.028996 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:06.028976    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c" event={"ID":"92c16db0-9b31-4107-ab5c-4eb1d46d667a","Type":"ContainerStarted","Data":"d75324e41563ac0482aba68e9e0d65534780caa0bf55c760347305343a63bd1d"}
Nov 03 06:00:07.604510 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:07.604473    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:07.773442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:07.773414    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:08.005816 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:08.005784    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:08.167673 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:08.167638    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:08.406205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:08.406167    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:08.577762 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:08.577714    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:11.050865 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:11.050828    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qm6zn" event={"ID":"da37b39a-f4c0-442f-bcf5-34ae76031b49","Type":"ContainerStarted","Data":"a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e"}
Nov 03 06:00:11.052301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:11.052281    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c" event={"ID":"92c16db0-9b31-4107-ab5c-4eb1d46d667a","Type":"ContainerStarted","Data":"84887c38f764c3b92d760d87d68f9d6f4e4a18f966608641152705efb97c4844"}
Nov 03 06:00:11.052373 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:11.052328    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:11.089880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:11.089831    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-qm6zn" podStartSLOduration=1.916114646 podStartE2EDuration="7.089818352s" totalImagesPullingTime="5.173703706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:11.088334762 +0000 UTC m=+298.458284845" watchObservedRunningTime="2026-11-03 06:00:11.089818352 +0000 UTC m=+298.459768436"
Nov 03 06:00:11.129202 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:11.129152    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c" podStartSLOduration=1.797291511 podStartE2EDuration="7.129136689s" totalImagesPullingTime="5.331845178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:11.127828295 +0000 UTC m=+298.497778382" watchObservedRunningTime="2026-11-03 06:00:11.129136689 +0000 UTC m=+298.499086772"
Nov 03 06:00:12.977941 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:12.977912    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-ntcx4"
Nov 03 06:00:16.433862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:16.433820    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:16.601062 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:16.601028    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:19.425261 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:19.425225    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:19.587823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:19.587788    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:20.751938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:20.751910    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-k5dz4"]
Nov 03 06:00:20.759332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:20.759308    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4"
Nov 03 06:00:20.762219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:20.762197    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5drjb\" (UniqueName: \"kubernetes.io/projected/ef40d685-525e-4ebc-b014-aa88aab6062d-kube-api-access-5drjb\") pod \"authorino-56c6c9ddd5-k5dz4\" (UID: \"ef40d685-525e-4ebc-b014-aa88aab6062d\") " pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4"
Nov 03 06:00:20.775925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:20.775901    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-k5dz4"]
Nov 03 06:00:20.863066 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:20.863029    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5drjb\" (UniqueName: \"kubernetes.io/projected/ef40d685-525e-4ebc-b014-aa88aab6062d-kube-api-access-5drjb\") pod \"authorino-56c6c9ddd5-k5dz4\" (UID: \"ef40d685-525e-4ebc-b014-aa88aab6062d\") " pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4"
Nov 03 06:00:20.886099 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:20.886065    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5drjb\" (UniqueName: \"kubernetes.io/projected/ef40d685-525e-4ebc-b014-aa88aab6062d-kube-api-access-5drjb\") pod \"authorino-56c6c9ddd5-k5dz4\" (UID: \"ef40d685-525e-4ebc-b014-aa88aab6062d\") " pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4"
Nov 03 06:00:21.071000 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:21.070916    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4"
Nov 03 06:00:21.366556 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:21.366472    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-k5dz4"]
Nov 03 06:00:21.368888 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:21.368862    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef40d685_525e_4ebc_b014_aa88aab6062d.slice/crio-bc60915389c173c515170a1122508e6a2f6cb5bd440e79fe03344de636914950 WatchSource:0}: Error finding container bc60915389c173c515170a1122508e6a2f6cb5bd440e79fe03344de636914950: Status 404 returned error can't find the container with id bc60915389c173c515170a1122508e6a2f6cb5bd440e79fe03344de636914950
Nov 03 06:00:21.370189 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:21.370167    4418 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 06:00:22.057451 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:22.057422    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:22.097652 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:22.097613    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4" event={"ID":"ef40d685-525e-4ebc-b014-aa88aab6062d","Type":"ContainerStarted","Data":"bc60915389c173c515170a1122508e6a2f6cb5bd440e79fe03344de636914950"}
Nov 03 06:00:23.103170 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.103081    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4" event={"ID":"ef40d685-525e-4ebc-b014-aa88aab6062d","Type":"ContainerStarted","Data":"213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c"}
Nov 03 06:00:23.141656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.141604    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4" podStartSLOduration=1.784047257 podStartE2EDuration="3.141588261s" totalImagesPullingTime="1.357541004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:23.140497442 +0000 UTC m=+310.510447525" watchObservedRunningTime="2026-11-03 06:00:23.141588261 +0000 UTC m=+310.511538345"
Nov 03 06:00:23.167815 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.167776    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qm6zn"]
Nov 03 06:00:23.168065 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.167963    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-qm6zn" podUID="da37b39a-f4c0-442f-bcf5-34ae76031b49" containerName="authorino" containerID="cri-o://a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e" gracePeriod=30
Nov 03 06:00:23.408347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.408323    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qm6zn"
Nov 03 06:00:23.483752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.483718    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/da37b39a-f4c0-442f-bcf5-34ae76031b49-kube-api-access-5ttcq\" (UniqueName: \"kubernetes.io/projected/da37b39a-f4c0-442f-bcf5-34ae76031b49-kube-api-access-5ttcq\") pod \"da37b39a-f4c0-442f-bcf5-34ae76031b49\" (UID: \"da37b39a-f4c0-442f-bcf5-34ae76031b49\") "
Nov 03 06:00:23.485949 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.485917    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da37b39a-f4c0-442f-bcf5-34ae76031b49-kube-api-access-5ttcq" pod "da37b39a-f4c0-442f-bcf5-34ae76031b49" (UID: "da37b39a-f4c0-442f-bcf5-34ae76031b49"). InnerVolumeSpecName "kube-api-access-5ttcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:00:23.584618 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:23.584583    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ttcq\" (UniqueName: \"kubernetes.io/projected/da37b39a-f4c0-442f-bcf5-34ae76031b49-kube-api-access-5ttcq\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:00:24.108496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.108460    4418 generic.go:356] "Generic (PLEG): container finished" podID="da37b39a-f4c0-442f-bcf5-34ae76031b49" containerID="a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e" exitCode=0
Nov 03 06:00:24.109013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.108531    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-qm6zn"
Nov 03 06:00:24.109013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.108553    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qm6zn" event={"ID":"da37b39a-f4c0-442f-bcf5-34ae76031b49","Type":"ContainerDied","Data":"a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e"}
Nov 03 06:00:24.109013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.108592    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-qm6zn" event={"ID":"da37b39a-f4c0-442f-bcf5-34ae76031b49","Type":"ContainerDied","Data":"fbf1ee21fe78cf648812e3ee649ccd52082c6df6abbe59888ffd47c4eebfd65e"}
Nov 03 06:00:24.109013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.108611    4418 scope.go:122] "RemoveContainer" containerID="a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e"
Nov 03 06:00:24.117577 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.117561    4418 scope.go:122] "RemoveContainer" containerID="a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e"
Nov 03 06:00:24.117861 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:00:24.117844    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e\": container with ID starting with a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e not found: ID does not exist" containerID="a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e"
Nov 03 06:00:24.117922 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.117870    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e"} err="failed to get container status \"a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e\": rpc error: code = NotFound desc = could not find container \"a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e\": container with ID starting with a6378b57b68706800f8ecfb0f1127230320186aa7ea898c507ef35beff7c3b6e not found: ID does not exist"
Nov 03 06:00:24.158605 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.158569    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qm6zn"]
Nov 03 06:00:24.162204 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.162180    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-qm6zn"]
Nov 03 06:00:24.782870 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:24.782835    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="da37b39a-f4c0-442f-bcf5-34ae76031b49" path="/var/lib/kubelet/pods/da37b39a-f4c0-442f-bcf5-34ae76031b49/volumes"
Nov 03 06:00:25.250353 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:25.250318    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:25.421174 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:25.421126    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:28.404769 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:00:28.404731    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:00:35.649462 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:35.649431    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-rl66c"]
Nov 03 06:00:35.649963 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:35.649731    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c" podUID="92c16db0-9b31-4107-ab5c-4eb1d46d667a" containerName="limitador" containerID="cri-o://84887c38f764c3b92d760d87d68f9d6f4e4a18f966608641152705efb97c4844" gracePeriod=30
Nov 03 06:00:36.157514 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.157467    4418 generic.go:356] "Generic (PLEG): container finished" podID="92c16db0-9b31-4107-ab5c-4eb1d46d667a" containerID="84887c38f764c3b92d760d87d68f9d6f4e4a18f966608641152705efb97c4844" exitCode=0
Nov 03 06:00:36.157652 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.157535    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c" event={"ID":"92c16db0-9b31-4107-ab5c-4eb1d46d667a","Type":"ContainerDied","Data":"84887c38f764c3b92d760d87d68f9d6f4e4a18f966608641152705efb97c4844"}
Nov 03 06:00:36.189109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.189087    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:36.291083 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.291021    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92c16db0-9b31-4107-ab5c-4eb1d46d667a-config-file\" (UniqueName: \"kubernetes.io/configmap/92c16db0-9b31-4107-ab5c-4eb1d46d667a-config-file\") pod \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") "
Nov 03 06:00:36.291083 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.291055    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92c16db0-9b31-4107-ab5c-4eb1d46d667a-kube-api-access-s275x\" (UniqueName: \"kubernetes.io/projected/92c16db0-9b31-4107-ab5c-4eb1d46d667a-kube-api-access-s275x\") pod \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\" (UID: \"92c16db0-9b31-4107-ab5c-4eb1d46d667a\") "
Nov 03 06:00:36.291440 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.291413    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c16db0-9b31-4107-ab5c-4eb1d46d667a-config-file" pod "92c16db0-9b31-4107-ab5c-4eb1d46d667a" (UID: "92c16db0-9b31-4107-ab5c-4eb1d46d667a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:00:36.293073 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.293047    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c16db0-9b31-4107-ab5c-4eb1d46d667a-kube-api-access-s275x" pod "92c16db0-9b31-4107-ab5c-4eb1d46d667a" (UID: "92c16db0-9b31-4107-ab5c-4eb1d46d667a"). InnerVolumeSpecName "kube-api-access-s275x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:00:36.392212 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.392184    4418 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92c16db0-9b31-4107-ab5c-4eb1d46d667a-config-file\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:00:36.392212 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:36.392209    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s275x\" (UniqueName: \"kubernetes.io/projected/92c16db0-9b31-4107-ab5c-4eb1d46d667a-kube-api-access-s275x\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:00:37.163416 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:37.163386    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c"
Nov 03 06:00:37.163416 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:37.163396    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-rl66c" event={"ID":"92c16db0-9b31-4107-ab5c-4eb1d46d667a","Type":"ContainerDied","Data":"d75324e41563ac0482aba68e9e0d65534780caa0bf55c760347305343a63bd1d"}
Nov 03 06:00:37.163933 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:37.163460    4418 scope.go:122] "RemoveContainer" containerID="84887c38f764c3b92d760d87d68f9d6f4e4a18f966608641152705efb97c4844"
Nov 03 06:00:37.213100 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:37.213075    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-rl66c"]
Nov 03 06:00:37.225123 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:37.225096    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-rl66c"]
Nov 03 06:00:38.028182 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.028150    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:38.289238 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.289155    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:38.781748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.781711    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92c16db0-9b31-4107-ab5c-4eb1d46d667a" path="/var/lib/kubelet/pods/92c16db0-9b31-4107-ab5c-4eb1d46d667a/volumes"
Nov 03 06:00:38.788875 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.788850    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"]
Nov 03 06:00:38.789522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.789479    4418 cpu_manager.go:414] "containerMap: removing container" podUID="da37b39a-f4c0-442f-bcf5-34ae76031b49" containerName="authorino"
Nov 03 06:00:38.789653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.789526    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="da37b39a-f4c0-442f-bcf5-34ae76031b49" containerName="authorino"
Nov 03 06:00:38.789653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.789550    4418 cpu_manager.go:414] "containerMap: removing container" podUID="92c16db0-9b31-4107-ab5c-4eb1d46d667a" containerName="limitador"
Nov 03 06:00:38.789653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.789558    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92c16db0-9b31-4107-ab5c-4eb1d46d667a" containerName="limitador"
Nov 03 06:00:38.789653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.789644    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="da37b39a-f4c0-442f-bcf5-34ae76031b49" containerName="authorino"
Nov 03 06:00:38.789653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.789656    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="92c16db0-9b31-4107-ab5c-4eb1d46d667a" containerName="limitador"
Nov 03 06:00:38.792971 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.792954    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:38.808739 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.808721    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 03 06:00:38.812280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.812259    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 03 06:00:38.822123 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.822104    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"]
Nov 03 06:00:38.909280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.909252    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 03 06:00:38.911666 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.911646    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kck9q\" (UniqueName: \"kubernetes.io/projected/379e1141-2b44-4a16-b609-538afd96059d-kube-api-access-kck9q\") pod \"postgres-7cdbf6dc44-wmss9\" (UID: \"379e1141-2b44-4a16-b609-538afd96059d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:38.911738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.911689    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/379e1141-2b44-4a16-b609-538afd96059d-data\") pod \"postgres-7cdbf6dc44-wmss9\" (UID: \"379e1141-2b44-4a16-b609-538afd96059d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:38.922193 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.922177    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-r5hbt\""
Nov 03 06:00:38.948600 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:38.948568    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:39.012745 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:39.012721    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kck9q\" (UniqueName: \"kubernetes.io/projected/379e1141-2b44-4a16-b609-538afd96059d-kube-api-access-kck9q\") pod \"postgres-7cdbf6dc44-wmss9\" (UID: \"379e1141-2b44-4a16-b609-538afd96059d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:39.012864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:39.012775    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/379e1141-2b44-4a16-b609-538afd96059d-data\") pod \"postgres-7cdbf6dc44-wmss9\" (UID: \"379e1141-2b44-4a16-b609-538afd96059d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:39.013191 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:39.013174    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/379e1141-2b44-4a16-b609-538afd96059d-data\") pod \"postgres-7cdbf6dc44-wmss9\" (UID: \"379e1141-2b44-4a16-b609-538afd96059d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:39.036343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:39.036291    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kck9q\" (UniqueName: \"kubernetes.io/projected/379e1141-2b44-4a16-b609-538afd96059d-kube-api-access-kck9q\") pod \"postgres-7cdbf6dc44-wmss9\" (UID: \"379e1141-2b44-4a16-b609-538afd96059d\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:39.105636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:39.105601    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:39.418574 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:39.418551    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"]
Nov 03 06:00:39.421163 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:39.421135    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379e1141_2b44_4a16_b609_538afd96059d.slice/crio-18316f8fdda59fe639ed0dacb5f70e42902a64b049b026216911b96a5a066c7c WatchSource:0}: Error finding container 18316f8fdda59fe639ed0dacb5f70e42902a64b049b026216911b96a5a066c7c: Status 404 returned error can't find the container with id 18316f8fdda59fe639ed0dacb5f70e42902a64b049b026216911b96a5a066c7c
Nov 03 06:00:40.186229 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:40.186189    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9" event={"ID":"379e1141-2b44-4a16-b609-538afd96059d","Type":"ContainerStarted","Data":"18316f8fdda59fe639ed0dacb5f70e42902a64b049b026216911b96a5a066c7c"}
Nov 03 06:00:44.322143 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.322101    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:44.489230 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.489179    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:44.558750 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.558720    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bm44l"]
Nov 03 06:00:44.562252 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.562231    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.579224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.579160    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cv67w\""
Nov 03 06:00:44.591702 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.591233    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Nov 03 06:00:44.593454 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.593432    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bm44l"]
Nov 03 06:00:44.598225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.598205    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"]
Nov 03 06:00:44.602984 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.602964    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.628139 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.628110    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"]
Nov 03 06:00:44.638827 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.638800    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 03 06:00:44.638967 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.638890    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fdgll\""
Nov 03 06:00:44.643390 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.643369    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-9q8nl"]
Nov 03 06:00:44.646781 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.646763    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:44.662781 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.662758    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxjhz\" (UniqueName: \"kubernetes.io/projected/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-kube-api-access-sxjhz\") pod \"llmisvc-controller-manager-869d5dcc5d-wjj7p\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.662871 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.662804    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad-cert\") pod \"kserve-controller-manager-776cc66d47-bm44l\" (UID: \"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.662920 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.662883    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-wjj7p\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.662920 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.662914    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vct\" (UniqueName: \"kubernetes.io/projected/9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad-kube-api-access-s7vct\") pod \"kserve-controller-manager-776cc66d47-bm44l\" (UID: \"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.668324 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.668298    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:44.674779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.674756    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-9q8nl"]
Nov 03 06:00:44.678917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.678900    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 03 06:00:44.679173 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.679152    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nrkgl\""
Nov 03 06:00:44.689351 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.689329    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-kcp47"]
Nov 03 06:00:44.692843 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.692823    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.713460 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.713434    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gg46p\""
Nov 03 06:00:44.713460 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.713457    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 03 06:00:44.713701 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.713497    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 03 06:00:44.717688 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.717668    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-kcp47"]
Nov 03 06:00:44.764021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.763992    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vct\" (UniqueName: \"kubernetes.io/projected/9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad-kube-api-access-s7vct\") pod \"kserve-controller-manager-776cc66d47-bm44l\" (UID: \"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.764204 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764042    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vfkz\" (UniqueName: \"kubernetes.io/projected/f900f26a-d724-41b4-b960-23ec731ac960-kube-api-access-7vfkz\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.764204 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764077    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10a3705-099d-4d82-85e1-02bcb560362d-tls-certs\") pod \"model-serving-api-75bd89fdfc-9q8nl\" (UID: \"f10a3705-099d-4d82-85e1-02bcb560362d\") " pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:44.764306 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764222    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxjhz\" (UniqueName: \"kubernetes.io/projected/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-kube-api-access-sxjhz\") pod \"llmisvc-controller-manager-869d5dcc5d-wjj7p\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.764306 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764253    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f900f26a-d724-41b4-b960-23ec731ac960-cert\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.764306 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764276    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgmm\" (UniqueName: \"kubernetes.io/projected/f10a3705-099d-4d82-85e1-02bcb560362d-kube-api-access-5wgmm\") pod \"model-serving-api-75bd89fdfc-9q8nl\" (UID: \"f10a3705-099d-4d82-85e1-02bcb560362d\") " pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:44.764453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764319    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad-cert\") pod \"kserve-controller-manager-776cc66d47-bm44l\" (UID: \"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.764453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764381    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-wjj7p\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.764453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.764409    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f900f26a-d724-41b4-b960-23ec731ac960-metrics-certs\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.766786 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.766757    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-wjj7p\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.766937 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.766919    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad-cert\") pod \"kserve-controller-manager-776cc66d47-bm44l\" (UID: \"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.786682 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.786655    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxjhz\" (UniqueName: \"kubernetes.io/projected/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-kube-api-access-sxjhz\") pod \"llmisvc-controller-manager-869d5dcc5d-wjj7p\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.786800 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.786753    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vct\" (UniqueName: \"kubernetes.io/projected/9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad-kube-api-access-s7vct\") pod \"kserve-controller-manager-776cc66d47-bm44l\" (UID: \"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad\") " pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.841793 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.841719    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:44.865803 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.865767    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f900f26a-d724-41b4-b960-23ec731ac960-metrics-certs\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.865936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.865826    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vfkz\" (UniqueName: \"kubernetes.io/projected/f900f26a-d724-41b4-b960-23ec731ac960-kube-api-access-7vfkz\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.865936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.865847    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10a3705-099d-4d82-85e1-02bcb560362d-tls-certs\") pod \"model-serving-api-75bd89fdfc-9q8nl\" (UID: \"f10a3705-099d-4d82-85e1-02bcb560362d\") " pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:44.865936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.865868    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f900f26a-d724-41b4-b960-23ec731ac960-cert\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.865936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.865887    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgmm\" (UniqueName: \"kubernetes.io/projected/f10a3705-099d-4d82-85e1-02bcb560362d-kube-api-access-5wgmm\") pod \"model-serving-api-75bd89fdfc-9q8nl\" (UID: \"f10a3705-099d-4d82-85e1-02bcb560362d\") " pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:44.868733 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.868707    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f10a3705-099d-4d82-85e1-02bcb560362d-tls-certs\") pod \"model-serving-api-75bd89fdfc-9q8nl\" (UID: \"f10a3705-099d-4d82-85e1-02bcb560362d\") " pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:44.868855 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.868734    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f900f26a-d724-41b4-b960-23ec731ac960-metrics-certs\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.868855 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.868756    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f900f26a-d724-41b4-b960-23ec731ac960-cert\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.875551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.875530    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:44.888715 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.888687    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vfkz\" (UniqueName: \"kubernetes.io/projected/f900f26a-d724-41b4-b960-23ec731ac960-kube-api-access-7vfkz\") pod \"odh-model-controller-769875db56-kcp47\" (UID: \"f900f26a-d724-41b4-b960-23ec731ac960\") " pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:44.888808 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.888787    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgmm\" (UniqueName: \"kubernetes.io/projected/f10a3705-099d-4d82-85e1-02bcb560362d-kube-api-access-5wgmm\") pod \"model-serving-api-75bd89fdfc-9q8nl\" (UID: \"f10a3705-099d-4d82-85e1-02bcb560362d\") " pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:44.918719 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.918684    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:44.959281 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:44.959037    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:45.010121 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.010086    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:45.099368 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.099281    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:45.170624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.170595    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-bm44l"]
Nov 03 06:00:45.173709 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:45.173678    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b80aa7f_711a_4414_bfd4_0a5bbbdf4dad.slice/crio-1b60be47a6a364a47e7a254dade64cf945fb412afb5a15b533e66d46fc2a754c WatchSource:0}: Error finding container 1b60be47a6a364a47e7a254dade64cf945fb412afb5a15b533e66d46fc2a754c: Status 404 returned error can't find the container with id 1b60be47a6a364a47e7a254dade64cf945fb412afb5a15b533e66d46fc2a754c
Nov 03 06:00:45.212431 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.212396    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l" event={"ID":"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad","Type":"ContainerStarted","Data":"1b60be47a6a364a47e7a254dade64cf945fb412afb5a15b533e66d46fc2a754c"}
Nov 03 06:00:45.214097 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.214072    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9" event={"ID":"379e1141-2b44-4a16-b609-538afd96059d","Type":"ContainerStarted","Data":"25ecef52f6912ddd7a5d25973be932054f7170aa98a72ef648a9c73cfe2b9a85"}
Nov 03 06:00:45.214235 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.214218    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:45.224120 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.224099    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"]
Nov 03 06:00:45.227268 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:45.227242    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc62bf01c_b8cb_4e1a_9745_f8b9a8062804.slice/crio-3fdb74801310b4042fb30f6e920d6622e28cfb5ef55a63da5923fa638c3b7b01 WatchSource:0}: Error finding container 3fdb74801310b4042fb30f6e920d6622e28cfb5ef55a63da5923fa638c3b7b01: Status 404 returned error can't find the container with id 3fdb74801310b4042fb30f6e920d6622e28cfb5ef55a63da5923fa638c3b7b01
Nov 03 06:00:45.256250 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.256203    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9" podStartSLOduration=2.296361437 podStartE2EDuration="7.256190258s" totalImagesPullingTime="4.959828821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:45.255791765 +0000 UTC m=+332.625741859" watchObservedRunningTime="2026-11-03 06:00:45.256190258 +0000 UTC m=+332.626140338"
Nov 03 06:00:45.277193 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.277151    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-9q8nl"]
Nov 03 06:00:45.280444 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:45.280409    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10a3705_099d_4d82_85e1_02bcb560362d.slice/crio-9a179e8d18042733c7d7d50e7e3fe4e0bf71ad6abf8302c1d62f018f767a1074 WatchSource:0}: Error finding container 9a179e8d18042733c7d7d50e7e3fe4e0bf71ad6abf8302c1d62f018f767a1074: Status 404 returned error can't find the container with id 9a179e8d18042733c7d7d50e7e3fe4e0bf71ad6abf8302c1d62f018f767a1074
Nov 03 06:00:45.313679 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:45.313652    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-kcp47"]
Nov 03 06:00:45.316292 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:45.316260    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf900f26a_d724_41b4_b960_23ec731ac960.slice/crio-b65f3182d4af3644e733740fd6b3b28e232daab9b2d8d89011ce882964cffa9f WatchSource:0}: Error finding container b65f3182d4af3644e733740fd6b3b28e232daab9b2d8d89011ce882964cffa9f: Status 404 returned error can't find the container with id b65f3182d4af3644e733740fd6b3b28e232daab9b2d8d89011ce882964cffa9f
Nov 03 06:00:46.232730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:46.232691    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl" event={"ID":"f10a3705-099d-4d82-85e1-02bcb560362d","Type":"ContainerStarted","Data":"9a179e8d18042733c7d7d50e7e3fe4e0bf71ad6abf8302c1d62f018f767a1074"}
Nov 03 06:00:46.235312 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:46.235270    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-kcp47" event={"ID":"f900f26a-d724-41b4-b960-23ec731ac960","Type":"ContainerStarted","Data":"b65f3182d4af3644e733740fd6b3b28e232daab9b2d8d89011ce882964cffa9f"}
Nov 03 06:00:46.242097 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:46.242066    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p" event={"ID":"c62bf01c-b8cb-4e1a-9745-f8b9a8062804","Type":"ContainerStarted","Data":"3fdb74801310b4042fb30f6e920d6622e28cfb5ef55a63da5923fa638c3b7b01"}
Nov 03 06:00:46.982609 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:46.982539    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:47.151430 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:47.151383    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:47.313070 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:47.312987    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:47.473562 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:47.473454    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:48.256261 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:48.256222    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl" event={"ID":"f10a3705-099d-4d82-85e1-02bcb560362d","Type":"ContainerStarted","Data":"1e26eb878c7d7d5c1db83159cb6aa2babf1325e929ef6126de97be043d0a6715"}
Nov 03 06:00:48.256652 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:48.256556    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:48.297776 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:48.297686    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl" podStartSLOduration=1.563363351 podStartE2EDuration="4.297669343s" totalImagesPullingTime="2.734305992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:48.296851772 +0000 UTC m=+335.666801857" watchObservedRunningTime="2026-11-03 06:00:48.297669343 +0000 UTC m=+335.667619426"
Nov 03 06:00:49.261895 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.261800    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p" event={"ID":"c62bf01c-b8cb-4e1a-9745-f8b9a8062804","Type":"ContainerStarted","Data":"1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e"}
Nov 03 06:00:49.262292 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.261960    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:00:49.263289 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.263257    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-kcp47" event={"ID":"f900f26a-d724-41b4-b960-23ec731ac960","Type":"ContainerStarted","Data":"f550b0debdc0f16bc62986a5ca208c6318706adcbf1182a76328815e62536f6a"}
Nov 03 06:00:49.263536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.263316    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:00:49.264862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.264839    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l" event={"ID":"9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad","Type":"ContainerStarted","Data":"fcff1d32dcbecc04e8960d3b917805e8fb2a40dd5eb73a5ef5c3ee4e83693ed3"}
Nov 03 06:00:49.264967 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.264952    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:00:49.303222 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.303176    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p" podStartSLOduration=2.183780654 podStartE2EDuration="5.303164627s" totalImagesPullingTime="3.119383973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:49.301444686 +0000 UTC m=+336.671394769" watchObservedRunningTime="2026-11-03 06:00:49.303164627 +0000 UTC m=+336.673114708"
Nov 03 06:00:49.340651 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.340596    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-kcp47" podStartSLOduration=1.704677186 podStartE2EDuration="5.340581552s" totalImagesPullingTime="3.635904366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:49.340268174 +0000 UTC m=+336.710218258" watchObservedRunningTime="2026-11-03 06:00:49.340581552 +0000 UTC m=+336.710531636"
Nov 03 06:00:49.380114 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:49.380066    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l" podStartSLOduration=2.249469624 podStartE2EDuration="5.38005363s" totalImagesPullingTime="3.130584006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:00:49.379299215 +0000 UTC m=+336.749249294" watchObservedRunningTime="2026-11-03 06:00:49.38005363 +0000 UTC m=+336.750003749"
Nov 03 06:00:51.270656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:51.270626    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wmss9"
Nov 03 06:00:58.404580 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:00:58.404540    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:00:58.414783 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.414739    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:58.441150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.441126    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-tgpjb"]
Nov 03 06:00:58.444705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.444688    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.461977 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.461953    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 03 06:00:58.473690 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.473665    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 03 06:00:58.473780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.473701    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4ffnq\""
Nov 03 06:00:58.473837 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.473794    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 03 06:00:58.476226 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.476205    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-tgpjb"]
Nov 03 06:00:58.593575 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.593544    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-metrics-certs\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.593704 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.593594    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5bf\" (UniqueName: \"kubernetes.io/projected/4391480c-49c4-4bc7-bd58-c93e51bb09f5-kube-api-access-pl5bf\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.593704 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.593654    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-webhook-cert\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.619752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.619719    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:58.694708 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.694652    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-metrics-certs\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.694708 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.694697    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5bf\" (UniqueName: \"kubernetes.io/projected/4391480c-49c4-4bc7-bd58-c93e51bb09f5-kube-api-access-pl5bf\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.694843 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.694726    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-webhook-cert\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.697199 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.697173    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-webhook-cert\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.697199 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.697189    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-metrics-certs\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.717400 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.717377    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5bf\" (UniqueName: \"kubernetes.io/projected/4391480c-49c4-4bc7-bd58-c93e51bb09f5-kube-api-access-pl5bf\") pod \"maas-controller-579cf7c6d-tgpjb\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") " pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.758000 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.757976    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:00:58.783778 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:58.783749    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:00:59.055376 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:59.055222    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-tgpjb"]
Nov 03 06:00:59.057563 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:00:59.057538    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4391480c_49c4_4bc7_bd58_c93e51bb09f5.slice/crio-7fc817a7db9f41cd741d1411974edb8eb580c387d13dce1f0adb8232cc23c7a7 WatchSource:0}: Error finding container 7fc817a7db9f41cd741d1411974edb8eb580c387d13dce1f0adb8232cc23c7a7: Status 404 returned error can't find the container with id 7fc817a7db9f41cd741d1411974edb8eb580c387d13dce1f0adb8232cc23c7a7
Nov 03 06:00:59.268584 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:59.268562    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-9q8nl"
Nov 03 06:00:59.313946 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:00:59.313881    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-tgpjb" event={"ID":"4391480c-49c4-4bc7-bd58-c93e51bb09f5","Type":"ContainerStarted","Data":"7fc817a7db9f41cd741d1411974edb8eb580c387d13dce1f0adb8232cc23c7a7"}
Nov 03 06:01:00.272093 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:00.272061    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-kcp47"
Nov 03 06:01:01.798423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:01.798325    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:01.964421 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:01.964383    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:02.329919 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:02.329879    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-tgpjb" event={"ID":"4391480c-49c4-4bc7-bd58-c93e51bb09f5","Type":"ContainerStarted","Data":"2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4"}
Nov 03 06:01:02.330106 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:02.330061    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:01:02.373464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:02.373416    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-tgpjb" podStartSLOduration=1.9123143790000001 podStartE2EDuration="4.373402619s" totalImagesPullingTime="2.46108824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:01:02.371898558 +0000 UTC m=+349.741848642" watchObservedRunningTime="2026-11-03 06:01:02.373402619 +0000 UTC m=+349.743352702"
Nov 03 06:01:02.853873 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:02.853835    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:03.020157 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:03.020126    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:03.689069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:03.689035    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:03.849695 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:03.849657    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:13.336116 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:13.336080    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:01:13.803667 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:13.803631    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-tgpjb"]
Nov 03 06:01:13.803951 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:13.803901    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-tgpjb" podUID="4391480c-49c4-4bc7-bd58-c93e51bb09f5" containerName="manager" containerID="cri-o://2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4" gracePeriod=30
Nov 03 06:01:14.049102 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.049074    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:01:14.225599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.225568    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-webhook-cert\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-webhook-cert\") pod \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") "
Nov 03 06:01:14.225773 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.225623    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-metrics-certs\") pod \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") "
Nov 03 06:01:14.225773 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.225682    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4391480c-49c4-4bc7-bd58-c93e51bb09f5-kube-api-access-pl5bf\" (UniqueName: \"kubernetes.io/projected/4391480c-49c4-4bc7-bd58-c93e51bb09f5-kube-api-access-pl5bf\") pod \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\" (UID: \"4391480c-49c4-4bc7-bd58-c93e51bb09f5\") "
Nov 03 06:01:14.227766 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.227734    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-webhook-cert" pod "4391480c-49c4-4bc7-bd58-c93e51bb09f5" (UID: "4391480c-49c4-4bc7-bd58-c93e51bb09f5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:01:14.227872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.227748    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-metrics-certs" pod "4391480c-49c4-4bc7-bd58-c93e51bb09f5" (UID: "4391480c-49c4-4bc7-bd58-c93e51bb09f5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:01:14.227872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.227792    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4391480c-49c4-4bc7-bd58-c93e51bb09f5-kube-api-access-pl5bf" pod "4391480c-49c4-4bc7-bd58-c93e51bb09f5" (UID: "4391480c-49c4-4bc7-bd58-c93e51bb09f5"). InnerVolumeSpecName "kube-api-access-pl5bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:01:14.326559 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.326529    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl5bf\" (UniqueName: \"kubernetes.io/projected/4391480c-49c4-4bc7-bd58-c93e51bb09f5-kube-api-access-pl5bf\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:14.326559 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.326560    4418 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-webhook-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:14.326729 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.326570    4418 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4391480c-49c4-4bc7-bd58-c93e51bb09f5-metrics-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:14.385407 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.385377    4418 generic.go:356] "Generic (PLEG): container finished" podID="4391480c-49c4-4bc7-bd58-c93e51bb09f5" containerID="2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4" exitCode=0
Nov 03 06:01:14.385776 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.385427    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-tgpjb"
Nov 03 06:01:14.385776 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.385466    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-tgpjb" event={"ID":"4391480c-49c4-4bc7-bd58-c93e51bb09f5","Type":"ContainerDied","Data":"2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4"}
Nov 03 06:01:14.385776 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.385548    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-tgpjb" event={"ID":"4391480c-49c4-4bc7-bd58-c93e51bb09f5","Type":"ContainerDied","Data":"7fc817a7db9f41cd741d1411974edb8eb580c387d13dce1f0adb8232cc23c7a7"}
Nov 03 06:01:14.385776 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.385576    4418 scope.go:122] "RemoveContainer" containerID="2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4"
Nov 03 06:01:14.394308 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.394293    4418 scope.go:122] "RemoveContainer" containerID="2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4"
Nov 03 06:01:14.394601 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:01:14.394582    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4\": container with ID starting with 2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4 not found: ID does not exist" containerID="2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4"
Nov 03 06:01:14.394642 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.394611    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4"} err="failed to get container status \"2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4\": rpc error: code = NotFound desc = could not find container \"2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4\": container with ID starting with 2af57a155bc89c78cd2f6500cbc7289414dfef22223e09df69a1b9fb61a0bec4 not found: ID does not exist"
Nov 03 06:01:14.435299 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.435269    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-tgpjb"]
Nov 03 06:01:14.446880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.446860    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-tgpjb"]
Nov 03 06:01:14.781332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:14.781302    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4391480c-49c4-4bc7-bd58-c93e51bb09f5" path="/var/lib/kubelet/pods/4391480c-49c4-4bc7-bd58-c93e51bb09f5/volumes"
Nov 03 06:01:20.272050 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:20.272009    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:01:20.275123 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:20.275102    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-bm44l"
Nov 03 06:01:28.405754 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:01:28.405714    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:01:37.386716 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:37.386683    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:37.556363 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:37.556315    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:38.802616 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:38.802587    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:38.971809 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:38.971768    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:39.132635 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.132585    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:39.307542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.307515    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"]
Nov 03 06:01:39.307940 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.307914    4418 cpu_manager.go:414] "containerMap: removing container" podUID="4391480c-49c4-4bc7-bd58-c93e51bb09f5" containerName="manager"
Nov 03 06:01:39.307940 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.307935    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4391480c-49c4-4bc7-bd58-c93e51bb09f5" containerName="manager"
Nov 03 06:01:39.308109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.308030    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="4391480c-49c4-4bc7-bd58-c93e51bb09f5" containerName="manager"
Nov 03 06:01:39.314360 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.314340    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.340487 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.340461    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 03 06:01:39.340615 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.340583    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 03 06:01:39.340615 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.340596    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k6kkr\""
Nov 03 06:01:39.342876 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.342857    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"]
Nov 03 06:01:39.432219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.432149    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf79s\" (UniqueName: \"kubernetes.io/projected/1396b887-6cc4-4de0-965b-5b187b46c593-kube-api-access-rf79s\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.432219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.432186    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-metrics-certs\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.432219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.432208    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-maas-api-tls\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.432426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.432288    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396b887-6cc4-4de0-965b-5b187b46c593-openshift-service-ca\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.533123 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.533094    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf79s\" (UniqueName: \"kubernetes.io/projected/1396b887-6cc4-4de0-965b-5b187b46c593-kube-api-access-rf79s\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.533266 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.533137    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-metrics-certs\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.533266 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.533170    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-maas-api-tls\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.533266 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.533204    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396b887-6cc4-4de0-965b-5b187b46c593-openshift-service-ca\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.533963 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.533942    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396b887-6cc4-4de0-965b-5b187b46c593-openshift-service-ca\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.535674 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.535652    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-metrics-certs\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.535744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.535730    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-maas-api-tls\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.555797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.555771    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf79s\" (UniqueName: \"kubernetes.io/projected/1396b887-6cc4-4de0-965b-5b187b46c593-kube-api-access-rf79s\") pod \"maas-api-6d669c7fcd-52hj5\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.626902 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.626880    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:39.921219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:39.921192    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"]
Nov 03 06:01:39.923584 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:01:39.923557    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1396b887_6cc4_4de0_965b_5b187b46c593.slice/crio-a80b2c9408a05dc169515f43169c85a2f1f66dc0facdb6f625ce102a88783a24 WatchSource:0}: Error finding container a80b2c9408a05dc169515f43169c85a2f1f66dc0facdb6f625ce102a88783a24: Status 404 returned error can't find the container with id a80b2c9408a05dc169515f43169c85a2f1f66dc0facdb6f625ce102a88783a24
Nov 03 06:01:40.496751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:40.496715    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5" event={"ID":"1396b887-6cc4-4de0-965b-5b187b46c593","Type":"ContainerStarted","Data":"a80b2c9408a05dc169515f43169c85a2f1f66dc0facdb6f625ce102a88783a24"}
Nov 03 06:01:42.506710 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:42.506678    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5" event={"ID":"1396b887-6cc4-4de0-965b-5b187b46c593","Type":"ContainerStarted","Data":"3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5"}
Nov 03 06:01:42.507110 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:42.506790    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:42.549280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:42.549235    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5" podStartSLOduration=1.91001906 podStartE2EDuration="3.549213106s" totalImagesPullingTime="1.639194046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:01:42.547585949 +0000 UTC m=+389.917536033" watchObservedRunningTime="2026-11-03 06:01:42.549213106 +0000 UTC m=+389.919163189"
Nov 03 06:01:48.516578 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:48.516545    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:49.044091 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.044060    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:49.210660 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.210621    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:49.292709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.292682    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4rvck"]
Nov 03 06:01:49.297691 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.297638    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4rvck"
Nov 03 06:01:49.317268 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.317248    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4rvck"]
Nov 03 06:01:49.416108 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.416080    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npx58\" (UniqueName: \"kubernetes.io/projected/82c51465-e4e4-46e6-ad6f-bf5733d6c555-kube-api-access-npx58\") pod \"authorino-6f6944bcdd-4rvck\" (UID: \"82c51465-e4e4-46e6-ad6f-bf5733d6c555\") " pod="kuadrant-system/authorino-6f6944bcdd-4rvck"
Nov 03 06:01:49.476553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.476518    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4rvck"]
Nov 03 06:01:49.476755 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:01:49.476732    4418 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-npx58], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-4rvck" podUID="82c51465-e4e4-46e6-ad6f-bf5733d6c555"
Nov 03 06:01:49.506615 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.506590    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-vf2fl"]
Nov 03 06:01:49.510401 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.510378    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:49.516783 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.516762    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npx58\" (UniqueName: \"kubernetes.io/projected/82c51465-e4e4-46e6-ad6f-bf5733d6c555-kube-api-access-npx58\") pod \"authorino-6f6944bcdd-4rvck\" (UID: \"82c51465-e4e4-46e6-ad6f-bf5733d6c555\") " pod="kuadrant-system/authorino-6f6944bcdd-4rvck"
Nov 03 06:01:49.525039 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.525011    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 03 06:01:49.533896 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.533876    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-vf2fl"]
Nov 03 06:01:49.543463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.543436    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npx58\" (UniqueName: \"kubernetes.io/projected/82c51465-e4e4-46e6-ad6f-bf5733d6c555-kube-api-access-npx58\") pod \"authorino-6f6944bcdd-4rvck\" (UID: \"82c51465-e4e4-46e6-ad6f-bf5733d6c555\") " pod="kuadrant-system/authorino-6f6944bcdd-4rvck"
Nov 03 06:01:49.551882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.551836    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4rvck"
Nov 03 06:01:49.558586 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.558570    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4rvck"
Nov 03 06:01:49.617426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.617403    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82c51465-e4e4-46e6-ad6f-bf5733d6c555-kube-api-access-npx58\" (UniqueName: \"kubernetes.io/projected/82c51465-e4e4-46e6-ad6f-bf5733d6c555-kube-api-access-npx58\") pod \"82c51465-e4e4-46e6-ad6f-bf5733d6c555\" (UID: \"82c51465-e4e4-46e6-ad6f-bf5733d6c555\") "
Nov 03 06:01:49.617562 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.617534    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-tls-cert\") pod \"authorino-6889cbd8c4-vf2fl\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") " pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:49.617621 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.617562    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcq6\" (UniqueName: \"kubernetes.io/projected/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-kube-api-access-trcq6\") pod \"authorino-6889cbd8c4-vf2fl\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") " pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:49.619340 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.619321    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c51465-e4e4-46e6-ad6f-bf5733d6c555-kube-api-access-npx58" pod "82c51465-e4e4-46e6-ad6f-bf5733d6c555" (UID: "82c51465-e4e4-46e6-ad6f-bf5733d6c555"). InnerVolumeSpecName "kube-api-access-npx58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:01:49.668400 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.668373    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-vf2fl"]
Nov 03 06:01:49.668635 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:01:49.668612    4418 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-trcq6 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-vf2fl" podUID="cf93a7f0-71a9-4031-adbe-ec4c4feb94b8"
Nov 03 06:01:49.697267 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.697238    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c6b9f7956-27tnr"]
Nov 03 06:01:49.700843 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.700825    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:49.718161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.718135    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-tls-cert\") pod \"authorino-6889cbd8c4-vf2fl\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") " pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:49.718251 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.718168    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcq6\" (UniqueName: \"kubernetes.io/projected/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-kube-api-access-trcq6\") pod \"authorino-6889cbd8c4-vf2fl\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") " pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:49.718251 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.718216    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npx58\" (UniqueName: \"kubernetes.io/projected/82c51465-e4e4-46e6-ad6f-bf5733d6c555-kube-api-access-npx58\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:49.720324 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.720305    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-tls-cert\") pod \"authorino-6889cbd8c4-vf2fl\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") " pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:49.724692 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.724674    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c6b9f7956-27tnr"]
Nov 03 06:01:49.746434 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.746412    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcq6\" (UniqueName: \"kubernetes.io/projected/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-kube-api-access-trcq6\") pod \"authorino-6889cbd8c4-vf2fl\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") " pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:49.818780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.818713    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmlc\" (UniqueName: \"kubernetes.io/projected/25f64dcf-dae0-45e9-a840-9084c948887b-kube-api-access-whmlc\") pod \"authorino-7c6b9f7956-27tnr\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") " pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:49.818780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.818749    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25f64dcf-dae0-45e9-a840-9084c948887b-tls-cert\") pod \"authorino-7c6b9f7956-27tnr\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") " pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:49.920165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.920132    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmlc\" (UniqueName: \"kubernetes.io/projected/25f64dcf-dae0-45e9-a840-9084c948887b-kube-api-access-whmlc\") pod \"authorino-7c6b9f7956-27tnr\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") " pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:49.920325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.920176    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25f64dcf-dae0-45e9-a840-9084c948887b-tls-cert\") pod \"authorino-7c6b9f7956-27tnr\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") " pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:49.922603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.922581    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25f64dcf-dae0-45e9-a840-9084c948887b-tls-cert\") pod \"authorino-7c6b9f7956-27tnr\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") " pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:49.942584 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:49.942561    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmlc\" (UniqueName: \"kubernetes.io/projected/25f64dcf-dae0-45e9-a840-9084c948887b-kube-api-access-whmlc\") pod \"authorino-7c6b9f7956-27tnr\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") " pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:50.013157 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.013134    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:01:50.305735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.305538    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c6b9f7956-27tnr"]
Nov 03 06:01:50.307948 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:01:50.307919    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25f64dcf_dae0_45e9_a840_9084c948887b.slice/crio-f5d612848e5392ff61f0d8b3c7c253bd324c7686f461e8c3efcc0d50efecc435 WatchSource:0}: Error finding container f5d612848e5392ff61f0d8b3c7c253bd324c7686f461e8c3efcc0d50efecc435: Status 404 returned error can't find the container with id f5d612848e5392ff61f0d8b3c7c253bd324c7686f461e8c3efcc0d50efecc435
Nov 03 06:01:50.557426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.557353    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9f7956-27tnr" event={"ID":"25f64dcf-dae0-45e9-a840-9084c948887b","Type":"ContainerStarted","Data":"f5d612848e5392ff61f0d8b3c7c253bd324c7686f461e8c3efcc0d50efecc435"}
Nov 03 06:01:50.557426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.557408    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:50.557843 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.557408    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4rvck"
Nov 03 06:01:50.565656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.565636    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:50.626355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.626334    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-kube-api-access-trcq6\" (UniqueName: \"kubernetes.io/projected/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-kube-api-access-trcq6\") pod \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") "
Nov 03 06:01:50.626481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.626377    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-tls-cert\" (UniqueName: \"kubernetes.io/secret/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-tls-cert\") pod \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\" (UID: \"cf93a7f0-71a9-4031-adbe-ec4c4feb94b8\") "
Nov 03 06:01:50.628394 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.628371    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-tls-cert" pod "cf93a7f0-71a9-4031-adbe-ec4c4feb94b8" (UID: "cf93a7f0-71a9-4031-adbe-ec4c4feb94b8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:01:50.628472 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.628392    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-kube-api-access-trcq6" pod "cf93a7f0-71a9-4031-adbe-ec4c4feb94b8" (UID: "cf93a7f0-71a9-4031-adbe-ec4c4feb94b8"). InnerVolumeSpecName "kube-api-access-trcq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:01:50.673849 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.673822    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4rvck"]
Nov 03 06:01:50.677622 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.677597    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4rvck"]
Nov 03 06:01:50.726917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.726894    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trcq6\" (UniqueName: \"kubernetes.io/projected/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-kube-api-access-trcq6\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:50.726917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.726918    4418 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8-tls-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:50.781370 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:50.781342    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82c51465-e4e4-46e6-ad6f-bf5733d6c555" path="/var/lib/kubelet/pods/82c51465-e4e4-46e6-ad6f-bf5733d6c555/volumes"
Nov 03 06:01:51.563496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.563463    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9f7956-27tnr" event={"ID":"25f64dcf-dae0-45e9-a840-9084c948887b","Type":"ContainerStarted","Data":"8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b"}
Nov 03 06:01:51.563982 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.563621    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-vf2fl"
Nov 03 06:01:51.604326 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.604280    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7c6b9f7956-27tnr" podStartSLOduration=2.079188921 podStartE2EDuration="2.60426765s" totalImagesPullingTime="525.078729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:01:51.603898459 +0000 UTC m=+398.973848544" watchObservedRunningTime="2026-11-03 06:01:51.60426765 +0000 UTC m=+398.974217734"
Nov 03 06:01:51.630985 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.630957    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-k5dz4"]
Nov 03 06:01:51.631151 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.631117    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4" podUID="ef40d685-525e-4ebc-b014-aa88aab6062d" containerName="authorino" containerID="cri-o://213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c" gracePeriod=30
Nov 03 06:01:51.662752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.662725    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-vf2fl"]
Nov 03 06:01:51.667119 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.667090    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-vf2fl"]
Nov 03 06:01:51.878694 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.878671    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4"
Nov 03 06:01:51.937581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.937548    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef40d685-525e-4ebc-b014-aa88aab6062d-kube-api-access-5drjb\" (UniqueName: \"kubernetes.io/projected/ef40d685-525e-4ebc-b014-aa88aab6062d-kube-api-access-5drjb\") pod \"ef40d685-525e-4ebc-b014-aa88aab6062d\" (UID: \"ef40d685-525e-4ebc-b014-aa88aab6062d\") "
Nov 03 06:01:51.939521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:51.939479    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef40d685-525e-4ebc-b014-aa88aab6062d-kube-api-access-5drjb" pod "ef40d685-525e-4ebc-b014-aa88aab6062d" (UID: "ef40d685-525e-4ebc-b014-aa88aab6062d"). InnerVolumeSpecName "kube-api-access-5drjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:01:52.038264 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.038232    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5drjb\" (UniqueName: \"kubernetes.io/projected/ef40d685-525e-4ebc-b014-aa88aab6062d-kube-api-access-5drjb\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:52.508963 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.508932    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"]
Nov 03 06:01:52.509334 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.509314    4418 cpu_manager.go:414] "containerMap: removing container" podUID="ef40d685-525e-4ebc-b014-aa88aab6062d" containerName="authorino"
Nov 03 06:01:52.509334 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.509327    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef40d685-525e-4ebc-b014-aa88aab6062d" containerName="authorino"
Nov 03 06:01:52.509445 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.509407    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef40d685-525e-4ebc-b014-aa88aab6062d" containerName="authorino"
Nov 03 06:01:52.512697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.512677    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:52.534637 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.534611    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"]
Nov 03 06:01:52.568995 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.568964    4418 generic.go:356] "Generic (PLEG): container finished" podID="ef40d685-525e-4ebc-b014-aa88aab6062d" containerID="213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c" exitCode=0
Nov 03 06:01:52.569440 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.569003    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4" event={"ID":"ef40d685-525e-4ebc-b014-aa88aab6062d","Type":"ContainerDied","Data":"213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c"}
Nov 03 06:01:52.569440 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.569030    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4"
Nov 03 06:01:52.569440 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.569043    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-k5dz4" event={"ID":"ef40d685-525e-4ebc-b014-aa88aab6062d","Type":"ContainerDied","Data":"bc60915389c173c515170a1122508e6a2f6cb5bd440e79fe03344de636914950"}
Nov 03 06:01:52.569440 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.569062    4418 scope.go:122] "RemoveContainer" containerID="213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c"
Nov 03 06:01:52.577962 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.577946    4418 scope.go:122] "RemoveContainer" containerID="213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c"
Nov 03 06:01:52.578236 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:01:52.578217    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c\": container with ID starting with 213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c not found: ID does not exist" containerID="213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c"
Nov 03 06:01:52.578283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.578246    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c"} err="failed to get container status \"213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c\": rpc error: code = NotFound desc = could not find container \"213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c\": container with ID starting with 213e2deb7128f54343c49ea15e329a80bcc7200a33b1f19c3ca5864c33fcd38c not found: ID does not exist"
Nov 03 06:01:52.622276 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.622250    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-k5dz4"]
Nov 03 06:01:52.628017 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.627997    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-k5dz4"]
Nov 03 06:01:52.641846 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.641816    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8496696-0e28-4642-adda-3cff900078d8-cert\") pod \"llmisvc-controller-manager-6466c554d8-pkcvl\" (UID: \"c8496696-0e28-4642-adda-3cff900078d8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:52.641987 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.641961    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fszwb\" (UniqueName: \"kubernetes.io/projected/c8496696-0e28-4642-adda-3cff900078d8-kube-api-access-fszwb\") pod \"llmisvc-controller-manager-6466c554d8-pkcvl\" (UID: \"c8496696-0e28-4642-adda-3cff900078d8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:52.743062 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.743033    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fszwb\" (UniqueName: \"kubernetes.io/projected/c8496696-0e28-4642-adda-3cff900078d8-kube-api-access-fszwb\") pod \"llmisvc-controller-manager-6466c554d8-pkcvl\" (UID: \"c8496696-0e28-4642-adda-3cff900078d8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:52.743198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.743082    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8496696-0e28-4642-adda-3cff900078d8-cert\") pod \"llmisvc-controller-manager-6466c554d8-pkcvl\" (UID: \"c8496696-0e28-4642-adda-3cff900078d8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:52.745392 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.745366    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8496696-0e28-4642-adda-3cff900078d8-cert\") pod \"llmisvc-controller-manager-6466c554d8-pkcvl\" (UID: \"c8496696-0e28-4642-adda-3cff900078d8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:52.765713 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.765666    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fszwb\" (UniqueName: \"kubernetes.io/projected/c8496696-0e28-4642-adda-3cff900078d8-kube-api-access-fszwb\") pod \"llmisvc-controller-manager-6466c554d8-pkcvl\" (UID: \"c8496696-0e28-4642-adda-3cff900078d8\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:52.781967 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.781946    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf93a7f0-71a9-4031-adbe-ec4c4feb94b8" path="/var/lib/kubelet/pods/cf93a7f0-71a9-4031-adbe-ec4c4feb94b8/volumes"
Nov 03 06:01:52.782195 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.782183    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef40d685-525e-4ebc-b014-aa88aab6062d" path="/var/lib/kubelet/pods/ef40d685-525e-4ebc-b014-aa88aab6062d/volumes"
Nov 03 06:01:52.825444 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:52.825421    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:53.122196 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:53.122039    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"]
Nov 03 06:01:53.124719 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:01:53.124694    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8496696_0e28_4642_adda_3cff900078d8.slice/crio-88bbda13354a3b17f5ed3bc6cde8b4d9f23b03eeb2c2329f0928fbd76764960b WatchSource:0}: Error finding container 88bbda13354a3b17f5ed3bc6cde8b4d9f23b03eeb2c2329f0928fbd76764960b: Status 404 returned error can't find the container with id 88bbda13354a3b17f5ed3bc6cde8b4d9f23b03eeb2c2329f0928fbd76764960b
Nov 03 06:01:53.575871 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:53.575844    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl" event={"ID":"c8496696-0e28-4642-adda-3cff900078d8","Type":"ContainerStarted","Data":"075220e13eba3faa77988fb3e2455c752bedaf0fd8cfa5d8ee6834002405e872"}
Nov 03 06:01:53.576306 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:53.575892    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl" event={"ID":"c8496696-0e28-4642-adda-3cff900078d8","Type":"ContainerStarted","Data":"88bbda13354a3b17f5ed3bc6cde8b4d9f23b03eeb2c2329f0928fbd76764960b"}
Nov 03 06:01:53.576306 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:53.575987    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:01:53.616882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:53.616831    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl" podStartSLOduration=1.23911938 podStartE2EDuration="1.616819205s" totalImagesPullingTime="377.699825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:01:53.615785412 +0000 UTC m=+400.985735495" watchObservedRunningTime="2026-11-03 06:01:53.616819205 +0000 UTC m=+400.986769289"
Nov 03 06:01:57.767546 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:57.767447    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:57.942400 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:57.942362    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:01:58.026845 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.026763    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"]
Nov 03 06:01:58.027013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.026948    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5" podUID="1396b887-6cc4-4de0-965b-5b187b46c593" containerName="maas-api" containerID="cri-o://3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5" gracePeriod=30
Nov 03 06:01:58.268374 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.268352    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:58.393116 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.393083    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1396b887-6cc4-4de0-965b-5b187b46c593-kube-api-access-rf79s\" (UniqueName: \"kubernetes.io/projected/1396b887-6cc4-4de0-965b-5b187b46c593-kube-api-access-rf79s\") pod \"1396b887-6cc4-4de0-965b-5b187b46c593\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") "
Nov 03 06:01:58.393279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.393186    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-maas-api-tls\") pod \"1396b887-6cc4-4de0-965b-5b187b46c593\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") "
Nov 03 06:01:58.393279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.393210    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-metrics-certs\") pod \"1396b887-6cc4-4de0-965b-5b187b46c593\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") "
Nov 03 06:01:58.393279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.393250    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1396b887-6cc4-4de0-965b-5b187b46c593-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396b887-6cc4-4de0-965b-5b187b46c593-openshift-service-ca\") pod \"1396b887-6cc4-4de0-965b-5b187b46c593\" (UID: \"1396b887-6cc4-4de0-965b-5b187b46c593\") "
Nov 03 06:01:58.393773 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.393742    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1396b887-6cc4-4de0-965b-5b187b46c593-openshift-service-ca" pod "1396b887-6cc4-4de0-965b-5b187b46c593" (UID: "1396b887-6cc4-4de0-965b-5b187b46c593"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:01:58.395369 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.395341    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-maas-api-tls" pod "1396b887-6cc4-4de0-965b-5b187b46c593" (UID: "1396b887-6cc4-4de0-965b-5b187b46c593"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:01:58.395590 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.395373    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-metrics-certs" pod "1396b887-6cc4-4de0-965b-5b187b46c593" (UID: "1396b887-6cc4-4de0-965b-5b187b46c593"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:01:58.395590 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.395393    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1396b887-6cc4-4de0-965b-5b187b46c593-kube-api-access-rf79s" pod "1396b887-6cc4-4de0-965b-5b187b46c593" (UID: "1396b887-6cc4-4de0-965b-5b187b46c593"). InnerVolumeSpecName "kube-api-access-rf79s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:01:58.404177 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:01:58.404146    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:01:58.494304 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.494280    4418 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396b887-6cc4-4de0-965b-5b187b46c593-openshift-service-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:58.494304 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.494300    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf79s\" (UniqueName: \"kubernetes.io/projected/1396b887-6cc4-4de0-965b-5b187b46c593-kube-api-access-rf79s\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:58.494418 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.494314    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-maas-api-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:58.494418 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.494326    4418 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1396b887-6cc4-4de0-965b-5b187b46c593-metrics-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:01:58.599154 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.599129    4418 generic.go:356] "Generic (PLEG): container finished" podID="1396b887-6cc4-4de0-965b-5b187b46c593" containerID="3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5" exitCode=0
Nov 03 06:01:58.599269 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.599170    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5" event={"ID":"1396b887-6cc4-4de0-965b-5b187b46c593","Type":"ContainerDied","Data":"3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5"}
Nov 03 06:01:58.599269 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.599175    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"
Nov 03 06:01:58.599269 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.599210    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5" event={"ID":"1396b887-6cc4-4de0-965b-5b187b46c593","Type":"ContainerDied","Data":"a80b2c9408a05dc169515f43169c85a2f1f66dc0facdb6f625ce102a88783a24"}
Nov 03 06:01:58.599269 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.599231    4418 scope.go:122] "RemoveContainer" containerID="3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5"
Nov 03 06:01:58.608354 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.608338    4418 scope.go:122] "RemoveContainer" containerID="3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5"
Nov 03 06:01:58.608660 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:01:58.608641    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5\": container with ID starting with 3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5 not found: ID does not exist" containerID="3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5"
Nov 03 06:01:58.608731 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.608674    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5"} err="failed to get container status \"3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5\": rpc error: code = NotFound desc = could not find container \"3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5\": container with ID starting with 3a23dda09d2c75b85f32bd321812d0436cd3f53f0ceb585bdb73ecdd8de316b5 not found: ID does not exist"
Nov 03 06:01:58.648638 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.648584    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"]
Nov 03 06:01:58.652651 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.652633    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-52hj5"]
Nov 03 06:01:58.781037 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:01:58.781010    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1396b887-6cc4-4de0-965b-5b187b46c593" path="/var/lib/kubelet/pods/1396b887-6cc4-4de0-965b-5b187b46c593/volumes"
Nov 03 06:02:03.846862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:03.846828    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:17.915067 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:17.915032    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:24.583459 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.583432    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pkcvl"
Nov 03 06:02:24.652008 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.651983    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"]
Nov 03 06:02:24.652212 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.652177    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p" podUID="c62bf01c-b8cb-4e1a-9745-f8b9a8062804" containerName="manager" containerID="cri-o://1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e" gracePeriod=30
Nov 03 06:02:24.897396 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.897374    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:02:24.907460 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.907439    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-cert\" (UniqueName: \"kubernetes.io/secret/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-cert\") pod \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") "
Nov 03 06:02:24.907574 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.907495    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-kube-api-access-sxjhz\" (UniqueName: \"kubernetes.io/projected/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-kube-api-access-sxjhz\") pod \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\" (UID: \"c62bf01c-b8cb-4e1a-9745-f8b9a8062804\") "
Nov 03 06:02:24.909489 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.909460    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-cert" pod "c62bf01c-b8cb-4e1a-9745-f8b9a8062804" (UID: "c62bf01c-b8cb-4e1a-9745-f8b9a8062804"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:02:24.909597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:24.909538    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-kube-api-access-sxjhz" pod "c62bf01c-b8cb-4e1a-9745-f8b9a8062804" (UID: "c62bf01c-b8cb-4e1a-9745-f8b9a8062804"). InnerVolumeSpecName "kube-api-access-sxjhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:02:25.008113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.008084    4418 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:02:25.008113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.008109    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxjhz\" (UniqueName: \"kubernetes.io/projected/c62bf01c-b8cb-4e1a-9745-f8b9a8062804-kube-api-access-sxjhz\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:02:25.546175 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.546122    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:25.727370 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.727330    4418 generic.go:356] "Generic (PLEG): container finished" podID="c62bf01c-b8cb-4e1a-9745-f8b9a8062804" containerID="1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e" exitCode=0
Nov 03 06:02:25.727802 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.727378    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"
Nov 03 06:02:25.727802 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.727404    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p" event={"ID":"c62bf01c-b8cb-4e1a-9745-f8b9a8062804","Type":"ContainerDied","Data":"1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e"}
Nov 03 06:02:25.727802 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.727488    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p" event={"ID":"c62bf01c-b8cb-4e1a-9745-f8b9a8062804","Type":"ContainerDied","Data":"3fdb74801310b4042fb30f6e920d6622e28cfb5ef55a63da5923fa638c3b7b01"}
Nov 03 06:02:25.727802 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.727550    4418 scope.go:122] "RemoveContainer" containerID="1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e"
Nov 03 06:02:25.736256 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.736239    4418 scope.go:122] "RemoveContainer" containerID="1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e"
Nov 03 06:02:25.736533 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:02:25.736493    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e\": container with ID starting with 1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e not found: ID does not exist" containerID="1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e"
Nov 03 06:02:25.736596 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.736546    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e"} err="failed to get container status \"1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e\": rpc error: code = NotFound desc = could not find container \"1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e\": container with ID starting with 1c96b3d69c9b57ff691c173d379d8dfca3003a194941e43c065599ed85ba966e not found: ID does not exist"
Nov 03 06:02:25.792935 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.792910    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"]
Nov 03 06:02:25.804966 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.804912    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-wjj7p"]
Nov 03 06:02:25.809468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:25.809441    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:26.781651 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:26.781610    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c62bf01c-b8cb-4e1a-9745-f8b9a8062804" path="/var/lib/kubelet/pods/c62bf01c-b8cb-4e1a-9745-f8b9a8062804/volumes"
Nov 03 06:02:28.414215 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:02:28.414179    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:02:40.826175 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:40.826137    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:42.557455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:42.557415    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:43.609144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:43.609106    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:44.801957 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:44.801923    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:46.827785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:46.827752    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:48.729064 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:48.729033    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:50.944021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:50.943973    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:52.212916 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:02:52.212875    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:02:58.403706 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:02:58.403673    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:03:03.977779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:03.977736    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:08.535312 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.535274    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7796c97cc5-7sf6p"]
Nov 03 06:03:08.535840 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.535818    4418 cpu_manager.go:414] "containerMap: removing container" podUID="1396b887-6cc4-4de0-965b-5b187b46c593" containerName="maas-api"
Nov 03 06:03:08.535915 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.535843    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1396b887-6cc4-4de0-965b-5b187b46c593" containerName="maas-api"
Nov 03 06:03:08.535915 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.535867    4418 cpu_manager.go:414] "containerMap: removing container" podUID="c62bf01c-b8cb-4e1a-9745-f8b9a8062804" containerName="manager"
Nov 03 06:03:08.535915 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.535875    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c62bf01c-b8cb-4e1a-9745-f8b9a8062804" containerName="manager"
Nov 03 06:03:08.536065 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.535993    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="1396b887-6cc4-4de0-965b-5b187b46c593" containerName="maas-api"
Nov 03 06:03:08.536065 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.536009    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="c62bf01c-b8cb-4e1a-9745-f8b9a8062804" containerName="manager"
Nov 03 06:03:08.539464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.539443    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:08.560622 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.560597    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7796c97cc5-7sf6p"]
Nov 03 06:03:08.691074 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.691041    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac-tls-cert\") pod \"authorino-7796c97cc5-7sf6p\" (UID: \"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac\") " pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:08.691263 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.691087    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwrhw\" (UniqueName: \"kubernetes.io/projected/a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac-kube-api-access-mwrhw\") pod \"authorino-7796c97cc5-7sf6p\" (UID: \"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac\") " pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:08.792260 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.792185    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac-tls-cert\") pod \"authorino-7796c97cc5-7sf6p\" (UID: \"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac\") " pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:08.792260 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.792227    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrhw\" (UniqueName: \"kubernetes.io/projected/a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac-kube-api-access-mwrhw\") pod \"authorino-7796c97cc5-7sf6p\" (UID: \"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac\") " pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:08.794560 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.794537    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac-tls-cert\") pod \"authorino-7796c97cc5-7sf6p\" (UID: \"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac\") " pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:08.814611 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.814584    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrhw\" (UniqueName: \"kubernetes.io/projected/a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac-kube-api-access-mwrhw\") pod \"authorino-7796c97cc5-7sf6p\" (UID: \"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac\") " pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:08.851105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:08.851077    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7796c97cc5-7sf6p"
Nov 03 06:03:09.143064 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:09.143036    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7796c97cc5-7sf6p"]
Nov 03 06:03:09.145916 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:03:09.145886    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4e8afb7_0ef9_4e43_a0be_d4f9494de4ac.slice/crio-db6d46772a884610f41452e16502078aa26d1a8e95e3340662ef30017954eaa2 WatchSource:0}: Error finding container db6d46772a884610f41452e16502078aa26d1a8e95e3340662ef30017954eaa2: Status 404 returned error can't find the container with id db6d46772a884610f41452e16502078aa26d1a8e95e3340662ef30017954eaa2
Nov 03 06:03:09.935630 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:09.935540    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7796c97cc5-7sf6p" event={"ID":"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac","Type":"ContainerStarted","Data":"36940a9c0f8dbea371086b7a40738432faf9d1fd9102fbbb998b183e17d4b43d"}
Nov 03 06:03:09.935630 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:09.935586    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7796c97cc5-7sf6p" event={"ID":"a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac","Type":"ContainerStarted","Data":"db6d46772a884610f41452e16502078aa26d1a8e95e3340662ef30017954eaa2"}
Nov 03 06:03:09.974605 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:09.974550    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7796c97cc5-7sf6p" podStartSLOduration=1.504472775 podStartE2EDuration="1.974536415s" totalImagesPullingTime="470.06364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:03:09.973211734 +0000 UTC m=+477.343161819" watchObservedRunningTime="2026-11-03 06:03:09.974536415 +0000 UTC m=+477.344486498"
Nov 03 06:03:10.004131 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.004094    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c6b9f7956-27tnr"]
Nov 03 06:03:10.004372 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.004319    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-7c6b9f7956-27tnr" podUID="25f64dcf-dae0-45e9-a840-9084c948887b" containerName="authorino" containerID="cri-o://8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b" gracePeriod=30
Nov 03 06:03:10.249032 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.249004    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:03:10.407708 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.407673    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/25f64dcf-dae0-45e9-a840-9084c948887b-tls-cert\" (UniqueName: \"kubernetes.io/secret/25f64dcf-dae0-45e9-a840-9084c948887b-tls-cert\") pod \"25f64dcf-dae0-45e9-a840-9084c948887b\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") "
Nov 03 06:03:10.407901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.407741    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25f64dcf-dae0-45e9-a840-9084c948887b-kube-api-access-whmlc\" (UniqueName: \"kubernetes.io/projected/25f64dcf-dae0-45e9-a840-9084c948887b-kube-api-access-whmlc\") pod \"25f64dcf-dae0-45e9-a840-9084c948887b\" (UID: \"25f64dcf-dae0-45e9-a840-9084c948887b\") "
Nov 03 06:03:10.409834 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.409802    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f64dcf-dae0-45e9-a840-9084c948887b-kube-api-access-whmlc" pod "25f64dcf-dae0-45e9-a840-9084c948887b" (UID: "25f64dcf-dae0-45e9-a840-9084c948887b"). InnerVolumeSpecName "kube-api-access-whmlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:03:10.417847 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.417818    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f64dcf-dae0-45e9-a840-9084c948887b-tls-cert" pod "25f64dcf-dae0-45e9-a840-9084c948887b" (UID: "25f64dcf-dae0-45e9-a840-9084c948887b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:03:10.509598 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.509494    4418 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/25f64dcf-dae0-45e9-a840-9084c948887b-tls-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:03:10.509598 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.509560    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whmlc\" (UniqueName: \"kubernetes.io/projected/25f64dcf-dae0-45e9-a840-9084c948887b-kube-api-access-whmlc\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:03:10.771601 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.771518    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:10.890432 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.890395    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"]
Nov 03 06:03:10.890841 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.890822    4418 cpu_manager.go:414] "containerMap: removing container" podUID="25f64dcf-dae0-45e9-a840-9084c948887b" containerName="authorino"
Nov 03 06:03:10.890841 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.890841    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25f64dcf-dae0-45e9-a840-9084c948887b" containerName="authorino"
Nov 03 06:03:10.890979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.890930    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="25f64dcf-dae0-45e9-a840-9084c948887b" containerName="authorino"
Nov 03 06:03:10.894188 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.894168    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:10.915094 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.915067    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 03 06:03:10.922775 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.922731    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"]
Nov 03 06:03:10.942987 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.942953    4418 generic.go:356] "Generic (PLEG): container finished" podID="25f64dcf-dae0-45e9-a840-9084c948887b" containerID="8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b" exitCode=0
Nov 03 06:03:10.943441 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.942994    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6b9f7956-27tnr"
Nov 03 06:03:10.943441 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.943034    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9f7956-27tnr" event={"ID":"25f64dcf-dae0-45e9-a840-9084c948887b","Type":"ContainerDied","Data":"8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b"}
Nov 03 06:03:10.943441 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.943080    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6b9f7956-27tnr" event={"ID":"25f64dcf-dae0-45e9-a840-9084c948887b","Type":"ContainerDied","Data":"f5d612848e5392ff61f0d8b3c7c253bd324c7686f461e8c3efcc0d50efecc435"}
Nov 03 06:03:10.943441 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.943098    4418 scope.go:122] "RemoveContainer" containerID="8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b"
Nov 03 06:03:10.951217 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.951192    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j7v45\""
Nov 03 06:03:10.953914 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.953893    4418 scope.go:122] "RemoveContainer" containerID="8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b"
Nov 03 06:03:10.954234 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:03:10.954211    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b\": container with ID starting with 8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b not found: ID does not exist" containerID="8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b"
Nov 03 06:03:10.954283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.954246    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b"} err="failed to get container status \"8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b\": rpc error: code = NotFound desc = could not find container \"8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b\": container with ID starting with 8f3cd08c2ed57bcca2e5e6fb493e72805df721f4923722bb8a9d6450f1e6bf7b not found: ID does not exist"
Nov 03 06:03:10.993469 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.993436    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c6b9f7956-27tnr"]
Nov 03 06:03:10.997625 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:10.997599    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c6b9f7956-27tnr"]
Nov 03 06:03:11.014736 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.014704    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.014882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.014740    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.014882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.014760    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.014979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.014878    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.014979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.014898    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.014979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.014921    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.015180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.015002    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.015180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.015067    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.015180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.015088    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mp2\" (UniqueName: \"kubernetes.io/projected/ef10258e-5fcc-4d6c-ba91-f31997a227ae-kube-api-access-96mp2\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.092802 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.092718    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:11.115809 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.115773    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.115991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.115835    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.115991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.115859    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mp2\" (UniqueName: \"kubernetes.io/projected/ef10258e-5fcc-4d6c-ba91-f31997a227ae-kube-api-access-96mp2\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.115991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.115898    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.115991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.115932    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.115991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.115958    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116016    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116044    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116137    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116251    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116341    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116378    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116411    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.116914 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.116895    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.118417 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.118395    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.119067 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.119047    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.141223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.141189    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef10258e-5fcc-4d6c-ba91-f31997a227ae-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.141362 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.141323    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mp2\" (UniqueName: \"kubernetes.io/projected/ef10258e-5fcc-4d6c-ba91-f31997a227ae-kube-api-access-96mp2\") pod \"maas-default-gateway-openshift-default-778b7b5c47-ngjk2\" (UID: \"ef10258e-5fcc-4d6c-ba91-f31997a227ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.209062 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.209022    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:11.528342 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.528239    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"]
Nov 03 06:03:11.531310 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:03:11.531283    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef10258e_5fcc_4d6c_ba91_f31997a227ae.slice/crio-dabb82521b398dfd44324e53e2726a40264c0a22c0a5862e29b9636974f54bfa WatchSource:0}: Error finding container dabb82521b398dfd44324e53e2726a40264c0a22c0a5862e29b9636974f54bfa: Status 404 returned error can't find the container with id dabb82521b398dfd44324e53e2726a40264c0a22c0a5862e29b9636974f54bfa
Nov 03 06:03:11.950354 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:11.950314    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" event={"ID":"ef10258e-5fcc-4d6c-ba91-f31997a227ae","Type":"ContainerStarted","Data":"dabb82521b398dfd44324e53e2726a40264c0a22c0a5862e29b9636974f54bfa"}
Nov 03 06:03:12.791089 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:12.791058    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25f64dcf-dae0-45e9-a840-9084c948887b" path="/var/lib/kubelet/pods/25f64dcf-dae0-45e9-a840-9084c948887b/volumes"
Nov 03 06:03:14.476387 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:14.476356    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:03:14.476679 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:14.476427    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:03:14.476679 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:14.476455    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:03:14.999374 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:14.998458    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" event={"ID":"ef10258e-5fcc-4d6c-ba91-f31997a227ae","Type":"ContainerStarted","Data":"d09a1fb4c88c95bb51cea5b7015fac6dbdfc138b7f876443fc84a8cad94adb99"}
Nov 03 06:03:15.056752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:15.056685    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podStartSLOduration=2.114556443 podStartE2EDuration="5.056666968s" totalImagesPullingTime="2.942110525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:03:15.054534239 +0000 UTC m=+482.424484324" watchObservedRunningTime="2026-11-03 06:03:15.056666968 +0000 UTC m=+482.426617053"
Nov 03 06:03:15.209844 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:15.209806    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:15.211573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:15.211541    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 03 06:03:15.211702 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:15.211601    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 03 06:03:16.210442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:16.210403    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 03 06:03:16.210842 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:16.210461    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 03 06:03:17.210145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:17.210105    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 03 06:03:17.210322 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:17.210187    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 03 06:03:17.770516 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:17.770470    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:17.940602 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:17.940562    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:18.210313 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:18.209862    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 03 06:03:18.210313 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:18.209942    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 03 06:03:19.209839 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:19.209808    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 03 06:03:19.210219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:19.209860    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 03 06:03:20.210150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:20.210108    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 03 06:03:20.210570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:20.210168    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 03 06:03:21.209369 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:21.209337    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 03 06:03:21.209552 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:21.209417    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 03 06:03:23.210954 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:23.210915    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:03:23.211411 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:23.210969    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:03:24.251646 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:24.251604    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:03:24.252090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:24.251668    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:03:24.712809 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:24.712765    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:24.713179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:24.713144    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:24.714309 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:24.714275    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2"
Nov 03 06:03:25.931286 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.931200    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"]
Nov 03 06:03:25.935015 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.934996    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.957859 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.957838    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"]
Nov 03 06:03:25.981030 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981004    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6c42\" (UniqueName: \"kubernetes.io/projected/60dd6d76-b7cd-40ed-aa14-e5c637969321-kube-api-access-k6c42\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981043    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981061    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981119    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981161    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60dd6d76-b7cd-40ed-aa14-e5c637969321-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981369 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981296    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981369 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981332    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981369 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981347    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:25.981542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:25.981463    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082611 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082572    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082611 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082614    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082639    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082676    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082749    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6c42\" (UniqueName: \"kubernetes.io/projected/60dd6d76-b7cd-40ed-aa14-e5c637969321-kube-api-access-k6c42\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082789    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082810    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082833    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.082944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.082858    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60dd6d76-b7cd-40ed-aa14-e5c637969321-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.083166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.083000    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.083166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.083049    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.083166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.083121    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.083166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.083156    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.083545 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.083528    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60dd6d76-b7cd-40ed-aa14-e5c637969321-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.085084 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.085050    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.085214 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.085200    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.105411 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.105381    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60dd6d76-b7cd-40ed-aa14-e5c637969321-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.105514 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.105405    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6c42\" (UniqueName: \"kubernetes.io/projected/60dd6d76-b7cd-40ed-aa14-e5c637969321-kube-api-access-k6c42\") pod \"maas-default-gateway-openshift-default-778b7b5c47-bgxkm\" (UID: \"60dd6d76-b7cd-40ed-aa14-e5c637969321\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.247391 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.247335    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:26.561058 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.561034    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"]
Nov 03 06:03:26.563259 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:03:26.563232    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60dd6d76_b7cd_40ed_aa14_e5c637969321.slice/crio-4b7f33f6e85ed8badd719395588c6d8bf661af1fe5c1aeafaf39005fd21faef3 WatchSource:0}: Error finding container 4b7f33f6e85ed8badd719395588c6d8bf661af1fe5c1aeafaf39005fd21faef3: Status 404 returned error can't find the container with id 4b7f33f6e85ed8badd719395588c6d8bf661af1fe5c1aeafaf39005fd21faef3
Nov 03 06:03:26.566282 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.566255    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:03:26.566366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.566314    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:03:26.566366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:26.566347    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:03:27.072714 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:27.072676    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" event={"ID":"60dd6d76-b7cd-40ed-aa14-e5c637969321","Type":"ContainerStarted","Data":"cb1ae1c38b85bd9870e42bbd29e822f1bc0ca7cd4b4b0307916446dc9f05557c"}
Nov 03 06:03:27.073201 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:27.072742    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" event={"ID":"60dd6d76-b7cd-40ed-aa14-e5c637969321","Type":"ContainerStarted","Data":"4b7f33f6e85ed8badd719395588c6d8bf661af1fe5c1aeafaf39005fd21faef3"}
Nov 03 06:03:27.143052 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:27.142988    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podStartSLOduration=2.142969654 podStartE2EDuration="2.142969654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:03:27.129055233 +0000 UTC m=+494.499005312" watchObservedRunningTime="2026-11-03 06:03:27.142969654 +0000 UTC m=+494.512919739"
Nov 03 06:03:27.248316 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:27.248283    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:27.249477 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:27.249455    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 03 06:03:27.249589 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:27.249523    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 03 06:03:28.248468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:28.248433    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 03 06:03:28.248884 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:28.248482    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 03 06:03:28.425062 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:03:28.425024    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:03:29.248539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:29.248487    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 03 06:03:29.248913 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:29.248556    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 03 06:03:30.248577 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:30.248541    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 03 06:03:30.249063 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:30.248593    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 03 06:03:31.248009 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:31.247976    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 03 06:03:31.248215 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:31.248030    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 03 06:03:32.247896 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:32.247862    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 03 06:03:32.248298 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:32.247918    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 03 06:03:33.248587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:33.248549    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 03 06:03:33.249092 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:33.248603    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 03 06:03:34.885380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:34.885345    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:34.885901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:34.885688    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:34.886459 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:34.886438    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm"
Nov 03 06:03:41.776595 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:41.776542    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:42.286797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:42.286761    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:43.885347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:43.885307    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:44.070994 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:44.070956    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:45.447094 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:45.447058    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:45.615404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:45.615366    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:56.806178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:03:56.806136    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:03:58.403581 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:03:58.403548    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:04:04.106654 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:04.106611    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:07.580794 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:07.580756    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:07.756829 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:07.756796    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:08.076398 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:08.076351    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:08.253685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:08.253649    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:08.434558 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:08.434497    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:08.611115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:08.611083    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:08.908262 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:08.908230    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:09.076031 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:09.075984    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:09.275745 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:09.275655    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:11.745735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:11.745696    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:11.917154 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:11.917120    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:12.090566 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:12.090468    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:12.278991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:12.278959    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:12.454826 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:12.454794    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:12.689830 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:12.689794    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:12.971758 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:12.971724    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:13.522956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:13.522921    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:13.702708 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:13.702674    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:13.900874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:13.900831    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:14.072836 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:14.072803    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:15.156974 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:15.156940    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:15.328870 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:15.328844    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:15.694656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:15.694621    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:15.861045 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:15.861009    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:17.507770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.507731    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:17.621442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.621409    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"]
Nov 03 06:04:17.625593 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.625571    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:17.642643 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.642617    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8zff\" (UniqueName: \"kubernetes.io/projected/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-kube-api-access-h8zff\") pod \"payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:17.642778 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.642664    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:17.646423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.646400    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"]
Nov 03 06:04:17.673372 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.673332    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:17.687636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.687613    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-9688d8\""
Nov 03 06:04:17.688165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.688145    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-9688d8-dockercfg-sqzwn\""
Nov 03 06:04:17.743838 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.743790    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8zff\" (UniqueName: \"kubernetes.io/projected/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-kube-api-access-h8zff\") pod \"payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:17.744034 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.743858    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:17.744605 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.744580    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:17.767895 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.767825    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8zff\" (UniqueName: \"kubernetes.io/projected/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-kube-api-access-h8zff\") pod \"payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:17.938570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:17.938524    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:18.243055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:18.243023    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"]
Nov 03 06:04:18.245671 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:18.245635    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd18b4fc_ebfc_40c2_be2a_43276a8eccd7.slice/crio-bbc64274d92b76c1ebeb157df585520fb1f21298f4e4dbab5ab4cb1b0e0b69ba WatchSource:0}: Error finding container bbc64274d92b76c1ebeb157df585520fb1f21298f4e4dbab5ab4cb1b0e0b69ba: Status 404 returned error can't find the container with id bbc64274d92b76c1ebeb157df585520fb1f21298f4e4dbab5ab4cb1b0e0b69ba
Nov 03 06:04:18.319590 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:18.319551    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" event={"ID":"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7","Type":"ContainerStarted","Data":"bbc64274d92b76c1ebeb157df585520fb1f21298f4e4dbab5ab4cb1b0e0b69ba"}
Nov 03 06:04:18.376030 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:18.375994    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:18.543021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:18.542916    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:19.202098 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.202069    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:19.251579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.247938    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"]
Nov 03 06:04:19.252184 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.252160    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.269951 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.269920    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"]
Nov 03 06:04:19.274336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.274294    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.279956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.279679    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-9688d8-serving-cert\""
Nov 03 06:04:19.280226 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.280203    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k6kkr\""
Nov 03 06:04:19.283770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.283649    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 03 06:04:19.287537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.286986    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"]
Nov 03 06:04:19.293856 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.293832    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-be1a66\""
Nov 03 06:04:19.296011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.295989    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"]
Nov 03 06:04:19.374102 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.374072    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-maas-api-tls\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.374286 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.374113    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a72340-5c3a-4d83-8931-791031f1a896-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.374286 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.374234    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vfzm\" (UniqueName: \"kubernetes.io/projected/44a72340-5c3a-4d83-8931-791031f1a896-kube-api-access-9vfzm\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.374410 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.374354    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-metrics-certs\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.374410 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.374387    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/538fb4be-1740-4814-b31e-ca5fdc22b819-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.374556 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.374414    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qkst\" (UniqueName: \"kubernetes.io/projected/538fb4be-1740-4814-b31e-ca5fdc22b819-kube-api-access-8qkst\") pod \"payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.384413 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.384381    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:19.475367 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.475280    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-metrics-certs\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.475367 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.475327    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/538fb4be-1740-4814-b31e-ca5fdc22b819-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.475367 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.475364    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qkst\" (UniqueName: \"kubernetes.io/projected/538fb4be-1740-4814-b31e-ca5fdc22b819-kube-api-access-8qkst\") pod \"payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.475685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.475544    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-maas-api-tls\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.475685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.475592    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a72340-5c3a-4d83-8931-791031f1a896-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.475685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.475645    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vfzm\" (UniqueName: \"kubernetes.io/projected/44a72340-5c3a-4d83-8931-791031f1a896-kube-api-access-9vfzm\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.476320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.476295    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a72340-5c3a-4d83-8931-791031f1a896-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.476320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.476308    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/538fb4be-1740-4814-b31e-ca5fdc22b819-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.478305 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.478277    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-metrics-certs\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.478305 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.478291    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-maas-api-tls\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.498673 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.498647    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qkst\" (UniqueName: \"kubernetes.io/projected/538fb4be-1740-4814-b31e-ca5fdc22b819-kube-api-access-8qkst\") pod \"payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.498797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.498653    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vfzm\" (UniqueName: \"kubernetes.io/projected/44a72340-5c3a-4d83-8931-791031f1a896-kube-api-access-9vfzm\") pod \"maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.544068 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.544035    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:19.569797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.569759    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:19.593246 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.593106    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:19.704237 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.704205    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:19.900141 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.900116    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"]
Nov 03 06:04:19.902294 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:19.902251    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"]
Nov 03 06:04:19.902833 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:19.902618    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538fb4be_1740_4814_b31e_ca5fdc22b819.slice/crio-463dd2b75ee7159af3d27aefd4b25393c8ace8a96502a5d20510c41a92ef13fc WatchSource:0}: Error finding container 463dd2b75ee7159af3d27aefd4b25393c8ace8a96502a5d20510c41a92ef13fc: Status 404 returned error can't find the container with id 463dd2b75ee7159af3d27aefd4b25393c8ace8a96502a5d20510c41a92ef13fc
Nov 03 06:04:19.906637 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:19.906608    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a72340_5c3a_4d83_8931_791031f1a896.slice/crio-e180d00b7fee75993560ff84e7d97b276e30a19097ce2280fde46ce914a05306 WatchSource:0}: Error finding container e180d00b7fee75993560ff84e7d97b276e30a19097ce2280fde46ce914a05306: Status 404 returned error can't find the container with id e180d00b7fee75993560ff84e7d97b276e30a19097ce2280fde46ce914a05306
Nov 03 06:04:20.141796 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:20.141764    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:20.316463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:20.316381    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:20.333689 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:20.333650    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" event={"ID":"538fb4be-1740-4814-b31e-ca5fdc22b819","Type":"ContainerStarted","Data":"463dd2b75ee7159af3d27aefd4b25393c8ace8a96502a5d20510c41a92ef13fc"}
Nov 03 06:04:20.334964 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:20.334934    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg" event={"ID":"44a72340-5c3a-4d83-8931-791031f1a896","Type":"ContainerStarted","Data":"e180d00b7fee75993560ff84e7d97b276e30a19097ce2280fde46ce914a05306"}
Nov 03 06:04:21.115055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.115021    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:21.294156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.294126    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:21.340906 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.340822    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" event={"ID":"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7","Type":"ContainerStarted","Data":"86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0"}
Nov 03 06:04:21.340906 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.340874    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:21.342308 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.342283    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" event={"ID":"538fb4be-1740-4814-b31e-ca5fdc22b819","Type":"ContainerStarted","Data":"a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63"}
Nov 03 06:04:21.342415 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.342388    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:21.343665 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.343642    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg" event={"ID":"44a72340-5c3a-4d83-8931-791031f1a896","Type":"ContainerStarted","Data":"b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317"}
Nov 03 06:04:21.343797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.343780    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:21.385510 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.385456    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" podStartSLOduration=2.012103856 podStartE2EDuration="4.385445595s" totalImagesPullingTime="2.373341739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:21.383812975 +0000 UTC m=+548.753763060" watchObservedRunningTime="2026-11-03 06:04:21.385445595 +0000 UTC m=+548.755395679"
Nov 03 06:04:21.424481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.424439    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" podStartSLOduration=1.242763043 podStartE2EDuration="2.424427019s" totalImagesPullingTime="1.181663976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:21.422962414 +0000 UTC m=+548.792912497" watchObservedRunningTime="2026-11-03 06:04:21.424427019 +0000 UTC m=+548.794377103"
Nov 03 06:04:21.459387 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.459355    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:21.463621 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:21.463584    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg" podStartSLOduration=1.997829684 podStartE2EDuration="2.463572226s" totalImagesPullingTime="465.742542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:21.462787359 +0000 UTC m=+548.832737443" watchObservedRunningTime="2026-11-03 06:04:21.463572226 +0000 UTC m=+548.833522309"
Nov 03 06:04:22.514046 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.514014    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:22.642579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.642549    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"]
Nov 03 06:04:22.645940 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.645918    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:22.673768 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.673741    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-86728b\""
Nov 03 06:04:22.673901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.673813    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-86728b-dockercfg-f2cqt\""
Nov 03 06:04:22.675526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.675494    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"]
Nov 03 06:04:22.696989 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.696967    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:22.707680 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.707649    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:22.707840 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.707818    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7mqk\" (UniqueName: \"kubernetes.io/projected/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-kube-api-access-x7mqk\") pod \"payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:22.772979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.772909    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"]
Nov 03 06:04:22.778380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.778355    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:22.797534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.797515    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-be1a66-serving-cert\""
Nov 03 06:04:22.799613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.799591    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"]
Nov 03 06:04:22.808437 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.808412    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7mqk\" (UniqueName: \"kubernetes.io/projected/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-kube-api-access-x7mqk\") pod \"payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:22.808582 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.808493    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:22.809283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.809263    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:22.839388 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.839366    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7mqk\" (UniqueName: \"kubernetes.io/projected/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-kube-api-access-x7mqk\") pod \"payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:22.909702 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.909667    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:22.909840 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.909704    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6snvw\" (UniqueName: \"kubernetes.io/projected/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-kube-api-access-6snvw\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:22.909936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.909905    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:22.910044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.909940    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-metrics-certs\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:22.925185 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.925160    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:22.959170 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:22.959145    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:23.013283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.013020    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.013283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.013065    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6snvw\" (UniqueName: \"kubernetes.io/projected/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-kube-api-access-6snvw\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.013283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.013133    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.013283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.013164    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-metrics-certs\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.020954 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.017790    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-metrics-certs\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.020954 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.019340    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.025568 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.025442    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.038846 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.038813    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6snvw\" (UniqueName: \"kubernetes.io/projected/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-kube-api-access-6snvw\") pod \"maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.092752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.092714    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:23.097580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.097538    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:23.258878 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.258849    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"]
Nov 03 06:04:23.261392 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:23.261366    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbde71a0_af0e_4cfb_af11_b3cc1fef02b0.slice/crio-74da6b169296bada318c558445afd4760cc1850b1c35dfaa91c8d8b47b9d7ef7 WatchSource:0}: Error finding container 74da6b169296bada318c558445afd4760cc1850b1c35dfaa91c8d8b47b9d7ef7: Status 404 returned error can't find the container with id 74da6b169296bada318c558445afd4760cc1850b1c35dfaa91c8d8b47b9d7ef7
Nov 03 06:04:23.353974 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.353944    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" event={"ID":"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0","Type":"ContainerStarted","Data":"41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34"}
Nov 03 06:04:23.354112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.354093    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:23.354161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.354133    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" event={"ID":"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0","Type":"ContainerStarted","Data":"74da6b169296bada318c558445afd4760cc1850b1c35dfaa91c8d8b47b9d7ef7"}
Nov 03 06:04:23.387012 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.386960    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"]
Nov 03 06:04:23.389493 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:23.389465    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4d463b_5e13_4b00_ba7c_de31ca33d4d7.slice/crio-ae6ceaf09b933c526dec7369098a27915115242442c4059454c47042caad6ddd WatchSource:0}: Error finding container ae6ceaf09b933c526dec7369098a27915115242442c4059454c47042caad6ddd: Status 404 returned error can't find the container with id ae6ceaf09b933c526dec7369098a27915115242442c4059454c47042caad6ddd
Nov 03 06:04:23.394857 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:23.394765    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" podStartSLOduration=1.394750969 podStartE2EDuration="1.394750969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:23.392790168 +0000 UTC m=+550.762740265" watchObservedRunningTime="2026-11-03 06:04:23.394750969 +0000 UTC m=+550.764701046"
Nov 03 06:04:24.360373 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:24.360330    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr" event={"ID":"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7","Type":"ContainerStarted","Data":"5207a992223ae2ff1b475d382b65d88c1c2d8daa82ba8ee3f669539b6ce00374"}
Nov 03 06:04:24.360913 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:24.360404    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr" event={"ID":"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7","Type":"ContainerStarted","Data":"ae6ceaf09b933c526dec7369098a27915115242442c4059454c47042caad6ddd"}
Nov 03 06:04:24.360913 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:24.360440    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:24.428444 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:24.428383    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr" podStartSLOduration=2.11098356 podStartE2EDuration="2.428366284s" totalImagesPullingTime="317.382724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:24.426889535 +0000 UTC m=+551.796839619" watchObservedRunningTime="2026-11-03 06:04:24.428366284 +0000 UTC m=+551.798316362"
Nov 03 06:04:24.870287 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:24.870254    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:26.282382 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.282354    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:26.451490 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.451446    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:26.503820 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.503788    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"]
Nov 03 06:04:26.507845 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.507824    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.522156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.522135    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-b7e447-serving-cert\""
Nov 03 06:04:26.536000 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.535925    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"]
Nov 03 06:04:26.652218 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.652186    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:26.653213 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.653191    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xst7g\" (UniqueName: \"kubernetes.io/projected/dba5e668-aed0-4dfd-8352-017b07a4558c-kube-api-access-xst7g\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.653295 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.653243    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba5e668-aed0-4dfd-8352-017b07a4558c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.653333 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.653303    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-metrics-certs\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.653378 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.653361    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.754497 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.754458    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xst7g\" (UniqueName: \"kubernetes.io/projected/dba5e668-aed0-4dfd-8352-017b07a4558c-kube-api-access-xst7g\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.754735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.754572    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba5e668-aed0-4dfd-8352-017b07a4558c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.754735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.754606    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-metrics-certs\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.754735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.754640    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.754893 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:04:26.754775    4418 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-serving-cert: secret "maas-api-e2e-worker-w3-b7e447-serving-cert" not found
Nov 03 06:04:26.754893 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:04:26.754831    4418 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls podName:dba5e668-aed0-4dfd-8352-017b07a4558c nodeName:}" failed. No retries permitted until 2026-11-03 06:04:27.254814926 +0000 UTC m=+554.624764987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls") pod "maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr" (UID: "dba5e668-aed0-4dfd-8352-017b07a4558c") : secret "maas-api-e2e-worker-w3-b7e447-serving-cert" not found
Nov 03 06:04:26.755341 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.755321    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba5e668-aed0-4dfd-8352-017b07a4558c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.757163 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.757142    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-metrics-certs\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.780303 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.780278    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xst7g\" (UniqueName: \"kubernetes.io/projected/dba5e668-aed0-4dfd-8352-017b07a4558c-kube-api-access-xst7g\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:26.813232 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:26.813170    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:27.188274 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:27.188239    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:27.260385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:27.260353    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:27.262706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:27.262685    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:27.353901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:27.353875    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:04:27.422301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:27.421496    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:27.725343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:27.725184    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"]
Nov 03 06:04:27.728102 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:27.728078    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba5e668_aed0_4dfd_8352_017b07a4558c.slice/crio-283cdf7a1cf6cb872c10ad590471bce6aa6d7621f1cdd9f3f761ea16081d1bb0 WatchSource:0}: Error finding container 283cdf7a1cf6cb872c10ad590471bce6aa6d7621f1cdd9f3f761ea16081d1bb0: Status 404 returned error can't find the container with id 283cdf7a1cf6cb872c10ad590471bce6aa6d7621f1cdd9f3f761ea16081d1bb0
Nov 03 06:04:28.380986 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:28.380911    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr" event={"ID":"dba5e668-aed0-4dfd-8352-017b07a4558c","Type":"ContainerStarted","Data":"7af1051f2c7008f2671d98eea55d9594031910eac434430aeb35ce8949dd2de8"}
Nov 03 06:04:28.380986 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:28.380966    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr" event={"ID":"dba5e668-aed0-4dfd-8352-017b07a4558c","Type":"ContainerStarted","Data":"283cdf7a1cf6cb872c10ad590471bce6aa6d7621f1cdd9f3f761ea16081d1bb0"}
Nov 03 06:04:28.381363 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:28.380989    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:28.405146 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:04:28.405114    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:04:28.423442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:28.423404    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr" podStartSLOduration=2.03471461 podStartE2EDuration="2.423391177s" totalImagesPullingTime="388.676567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:28.422350947 +0000 UTC m=+555.792301031" watchObservedRunningTime="2026-11-03 06:04:28.423391177 +0000 UTC m=+555.793341262"
Nov 03 06:04:28.657107 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:28.657026    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:28.829822 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:28.829783    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:30.370018 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:30.369993    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:04:30.438421 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:30.438379    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:31.775590 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:31.775552    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:32.350992 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:32.350964    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:04:32.351184 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:32.351031    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:04:32.382706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:32.382672    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:32.557185 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:32.557150    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:34.364071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:34.364039    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:04:34.390878 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:34.390853    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:04:34.825639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:34.825559    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:36.157113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:36.157084    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:37.910586 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:37.910553    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:39.161087 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:39.161051    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:41.239082 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:41.239034    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:42.507936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:42.507909    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:42.669576 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:42.669543    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:43.116585 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:43.116552    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:43.285206 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:43.285170    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:43.463332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:43.463250    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:45.276716 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:45.276687    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:47.278874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.278838    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:47.445815 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.445787    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"]
Nov 03 06:04:47.453620 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.453590    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.468381 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.468297    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"]
Nov 03 06:04:47.477995 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.477972    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-5c3542\"/\"kube-root-ca.crt\""
Nov 03 06:04:47.478153 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.478075    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-5c3542\"/\"simulator-w2-5c3542-kserve-self-signed-certs\""
Nov 03 06:04:47.478153 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.478142    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-5c3542\"/\"openshift-service-ca.crt\""
Nov 03 06:04:47.482339 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.482322    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-5c3542\"/\"default-dockercfg-nhbrc\""
Nov 03 06:04:47.553385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.553289    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwbw2\" (UniqueName: \"kubernetes.io/projected/6f0caac6-1354-4401-9713-3cf60f31487f-kube-api-access-qwbw2\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.553636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.553435    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0caac6-1354-4401-9713-3cf60f31487f-tls-certs\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.553636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.553536    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-dshm\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.553636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.553584    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-home\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.553636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.553610    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-model-cache\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.553823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.553638    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-tmp-dir\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.560458 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.560430    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:47.654536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.654481    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwbw2\" (UniqueName: \"kubernetes.io/projected/6f0caac6-1354-4401-9713-3cf60f31487f-kube-api-access-qwbw2\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.654735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.654569    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0caac6-1354-4401-9713-3cf60f31487f-tls-certs\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.654735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.654598    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-dshm\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.654735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.654655    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-home\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.654735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.654679    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-model-cache\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.654932 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.654730    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-tmp-dir\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.655122 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.655099    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-model-cache\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.655189 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.655118    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-home\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.655227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.655202    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-tmp-dir\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.656906 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.656880    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-dshm\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.657046 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.657031    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0caac6-1354-4401-9713-3cf60f31487f-tls-certs\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.679841 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.679819    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwbw2\" (UniqueName: \"kubernetes.io/projected/6f0caac6-1354-4401-9713-3cf60f31487f-kube-api-access-qwbw2\") pod \"simulator-w2-5c3542-kserve-86c5798447-8x4tx\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") " pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:47.769473 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:47.769443    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:48.064564 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.064539    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"]
Nov 03 06:04:48.066753 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:48.066725    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f0caac6_1354_4401_9713_3cf60f31487f.slice/crio-25985ab822386d5ef6c10148e4033a83212ecd34d39c28cf1cd70f3f8b2f4ddc WatchSource:0}: Error finding container 25985ab822386d5ef6c10148e4033a83212ecd34d39c28cf1cd70f3f8b2f4ddc: Status 404 returned error can't find the container with id 25985ab822386d5ef6c10148e4033a83212ecd34d39c28cf1cd70f3f8b2f4ddc
Nov 03 06:04:48.308972 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.308936    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:48.484229 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.484198    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:48.503232 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.503167    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" event={"ID":"6f0caac6-1354-4401-9713-3cf60f31487f","Type":"ContainerStarted","Data":"25985ab822386d5ef6c10148e4033a83212ecd34d39c28cf1cd70f3f8b2f4ddc"}
Nov 03 06:04:48.575526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.574831    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"]
Nov 03 06:04:48.591201 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.591172    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.596461 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.596429    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"]
Nov 03 06:04:48.606580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.606556    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-9688d8\"/\"simulator-w1-9688d8-kserve-self-signed-certs\""
Nov 03 06:04:48.606706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.606653    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-9688d8\"/\"openshift-service-ca.crt\""
Nov 03 06:04:48.617395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.617373    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-9688d8\"/\"default-dockercfg-zgwhm\""
Nov 03 06:04:48.617395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.617375    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-9688d8\"/\"kube-root-ca.crt\""
Nov 03 06:04:48.665984 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.665952    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-home\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.666219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.665998    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-dshm\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.666219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.666038    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-tmp-dir\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.666219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.666148    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840055d2-ee63-4220-9fa1-536a5bd7fde4-tls-certs\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.666219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.666184    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-model-cache\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.666443 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.666284    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgbkx\" (UniqueName: \"kubernetes.io/projected/840055d2-ee63-4220-9fa1-536a5bd7fde4-kube-api-access-fgbkx\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.682863 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.682797    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:48.767668 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.767591    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgbkx\" (UniqueName: \"kubernetes.io/projected/840055d2-ee63-4220-9fa1-536a5bd7fde4-kube-api-access-fgbkx\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.767812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.767678    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-home\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.767812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.767708    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-dshm\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.767812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.767745    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-tmp-dir\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.767812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.767778    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840055d2-ee63-4220-9fa1-536a5bd7fde4-tls-certs\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.767812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.767804    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-model-cache\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.768134 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.768081    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-home\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.768134 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.768132    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-tmp-dir\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.768393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.768374    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-model-cache\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.769940 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.769912    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-dshm\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.770767 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.770748    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840055d2-ee63-4220-9fa1-536a5bd7fde4-tls-certs\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.790575 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.790548    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgbkx\" (UniqueName: \"kubernetes.io/projected/840055d2-ee63-4220-9fa1-536a5bd7fde4-kube-api-access-fgbkx\") pod \"simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") " pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.909351 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.909316    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:48.940115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:48.940082    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:49.112934 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.112787    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:49.218278 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.218248    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"]
Nov 03 06:04:49.220102 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:04:49.220074    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod840055d2_ee63_4220_9fa1_536a5bd7fde4.slice/crio-c676b65bdb1bd1583873f0600fe93c1039229d07b8e89e3db6b58afc721cc2d2 WatchSource:0}: Error finding container c676b65bdb1bd1583873f0600fe93c1039229d07b8e89e3db6b58afc721cc2d2: Status 404 returned error can't find the container with id c676b65bdb1bd1583873f0600fe93c1039229d07b8e89e3db6b58afc721cc2d2
Nov 03 06:04:49.284256 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.284230    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:49.511064 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.511027    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" event={"ID":"840055d2-ee63-4220-9fa1-536a5bd7fde4","Type":"ContainerStarted","Data":"2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28"}
Nov 03 06:04:49.511529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.511079    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" event={"ID":"840055d2-ee63-4220-9fa1-536a5bd7fde4","Type":"ContainerStarted","Data":"c676b65bdb1bd1583873f0600fe93c1039229d07b8e89e3db6b58afc721cc2d2"}
Nov 03 06:04:49.512626 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.512595    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" event={"ID":"6f0caac6-1354-4401-9713-3cf60f31487f","Type":"ContainerStarted","Data":"8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe"}
Nov 03 06:04:49.562400 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.562345    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podStartSLOduration=1.3852204289999999 podStartE2EDuration="1.562331253s" totalImagesPullingTime="177.110824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:49.560857362 +0000 UTC m=+576.930807446" watchObservedRunningTime="2026-11-03 06:04:49.562331253 +0000 UTC m=+576.932281336"
Nov 03 06:04:49.608495 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.608445    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podStartSLOduration=1.450181293 podStartE2EDuration="2.60843095s" totalImagesPullingTime="1.158249657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:04:49.60695567 +0000 UTC m=+576.976905755" watchObservedRunningTime="2026-11-03 06:04:49.60843095 +0000 UTC m=+576.978381034"
Nov 03 06:04:49.770019 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.769937    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:49.910332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:49.910296    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:51.049910 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:51.049872    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:51.347233 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:51.347157    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:52.756554 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:52.756520    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:54.588762 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:54.588722    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:56.140839 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:56.140756    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:57.770138 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:57.770108    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:57.783283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:57.783251    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:57.787794 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:57.787769    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:58.121082 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:58.121038    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:58.403882 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:04:58.403792    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:04:58.566175 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:58.566150    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:04:58.909490 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:58.909448    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:58.922234 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:58.922213    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:04:59.540689 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:59.540654    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:04:59.573552 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:04:59.573526    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:05:01.219865 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:01.219834    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:02.828819 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:02.828782    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:03.788384 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.788354    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"]
Nov 03 06:05:03.792327 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.792304    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.806925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.806904    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-b7e447\"/\"kube-root-ca.crt\""
Nov 03 06:05:03.808212 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.808186    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ec877e-00f3-4188-b250-43ee90143f9f-tls-certs\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.808312 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.808294    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-tmp-dir\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.808461 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.808404    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-model-cache\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.808555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.808477    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-home\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.808555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.808515    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-dshm\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.808673 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.808583    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwl7w\" (UniqueName: \"kubernetes.io/projected/e5ec877e-00f3-4188-b250-43ee90143f9f-kube-api-access-mwl7w\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.818784 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.818763    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-b7e447\"/\"default-dockercfg-xxndc\""
Nov 03 06:05:03.818892 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.818781    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-b7e447\"/\"openshift-service-ca.crt\""
Nov 03 06:05:03.818892 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.818872    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-b7e447\"/\"simulator-w3-b7e447-kserve-self-signed-certs\""
Nov 03 06:05:03.820877 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.820857    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"]
Nov 03 06:05:03.905645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.905614    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:03.909817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.909787    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-model-cache\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.909930 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.909829    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-home\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.909930 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.909858    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-dshm\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.909930 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.909887    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwl7w\" (UniqueName: \"kubernetes.io/projected/e5ec877e-00f3-4188-b250-43ee90143f9f-kube-api-access-mwl7w\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.910112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.909991    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ec877e-00f3-4188-b250-43ee90143f9f-tls-certs\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.910112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.910082    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-tmp-dir\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.910279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.910216    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-model-cache\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.910279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.910267    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-home\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.910520 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.910481    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-tmp-dir\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.912541 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.912514    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-dshm\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.913092 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.913075    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ec877e-00f3-4188-b250-43ee90143f9f-tls-certs\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:03.936420 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:03.936390    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwl7w\" (UniqueName: \"kubernetes.io/projected/e5ec877e-00f3-4188-b250-43ee90143f9f-kube-api-access-mwl7w\") pod \"simulator-w3-b7e447-kserve-5b7c555d55-gwmrh\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") " pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:04.108553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:04.108438    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:04.247133 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:04.247097    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:04.425415 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:04.425371    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"]
Nov 03 06:05:04.441549 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:05:04.441520    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5ec877e_00f3_4188_b250_43ee90143f9f.slice/crio-28e0816479266bacb75641a455d72e5a03f89f02db32d1c681f47a0f47b0c669 WatchSource:0}: Error finding container 28e0816479266bacb75641a455d72e5a03f89f02db32d1c681f47a0f47b0c669: Status 404 returned error can't find the container with id 28e0816479266bacb75641a455d72e5a03f89f02db32d1c681f47a0f47b0c669
Nov 03 06:05:04.500870 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:04.500843    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:04.588694 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:04.588652    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" event={"ID":"e5ec877e-00f3-4188-b250-43ee90143f9f","Type":"ContainerStarted","Data":"e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb"}
Nov 03 06:05:04.588883 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:04.588700    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" event={"ID":"e5ec877e-00f3-4188-b250-43ee90143f9f","Type":"ContainerStarted","Data":"28e0816479266bacb75641a455d72e5a03f89f02db32d1c681f47a0f47b0c669"}
Nov 03 06:05:04.634899 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:04.634834    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podStartSLOduration=1.6348152599999999 podStartE2EDuration="1.63481526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:05:04.632118206 +0000 UTC m=+592.002068290" watchObservedRunningTime="2026-11-03 06:05:04.63481526 +0000 UTC m=+592.004765346"
Nov 03 06:05:05.079054 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:05.078994    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:05.108910 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:05.108881    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:06.268712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:06.268671    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:07.951195 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:07.951166    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:09.617475 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:09.617426    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:11.344704 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:11.344658    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:13.004730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:13.004683    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:13.571880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:13.571841    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:14.109017 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:14.108981    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:14.121562 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:14.121538    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:14.641125 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:14.641093    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:14.650449 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:14.650431    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:05:16.341362 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:16.341328    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:17.985880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:17.985846    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:18.153979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:18.153941    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:19.656738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:19.656687    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:19.828429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:19.828399    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:21.355410 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:21.355375    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:22.978542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:22.978485    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:24.578526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:24.576330    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:26.292765 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.292711    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:26.459865 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.459835    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"]
Nov 03 06:05:26.466875 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.466849    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.496766 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.496740    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-9688d8\"/\"premium-w1-9688d8-kserve-self-signed-certs\""
Nov 03 06:05:26.498862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.498843    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"]
Nov 03 06:05:26.530882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.530837    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8lks\" (UniqueName: \"kubernetes.io/projected/1f5dad80-945c-4941-81a9-94367d37de44-kube-api-access-z8lks\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.531042 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.530894    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-model-cache\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.531042 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.531022    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-dshm\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.531128 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.531066    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-home\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.531220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.531204    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5dad80-945c-4941-81a9-94367d37de44-tls-certs\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.531260 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.531248    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-tmp-dir\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.575113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.575010    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:26.632567 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.632522    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8lks\" (UniqueName: \"kubernetes.io/projected/1f5dad80-945c-4941-81a9-94367d37de44-kube-api-access-z8lks\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.632751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.632578    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-model-cache\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.632751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.632626    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-dshm\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.632751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.632652    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-home\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.632751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.632748    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5dad80-945c-4941-81a9-94367d37de44-tls-certs\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.632982 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.632787    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-tmp-dir\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.633118 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.633088    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-model-cache\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.633257 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.633135    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-tmp-dir\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.633456 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.633435    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-home\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.635539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.635488    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5dad80-945c-4941-81a9-94367d37de44-tls-certs\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.635841 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.635821    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-dshm\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.657999 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.657940    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8lks\" (UniqueName: \"kubernetes.io/projected/1f5dad80-945c-4941-81a9-94367d37de44-kube-api-access-z8lks\") pod \"premium-w1-9688d8-kserve-7965f4f98d-gjghm\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") " pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:26.781539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:26.781486    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:27.103792 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:27.103757    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"]
Nov 03 06:05:27.105614 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:05:27.105585    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f5dad80_945c_4941_81a9_94367d37de44.slice/crio-d519e34ca0924a6b520289f8b27b1bb63780ba375b24a0618ab0fe8c209c9316 WatchSource:0}: Error finding container d519e34ca0924a6b520289f8b27b1bb63780ba375b24a0618ab0fe8c209c9316: Status 404 returned error can't find the container with id d519e34ca0924a6b520289f8b27b1bb63780ba375b24a0618ab0fe8c209c9316
Nov 03 06:05:27.707439 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:27.707392    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" event={"ID":"1f5dad80-945c-4941-81a9-94367d37de44","Type":"ContainerStarted","Data":"a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9"}
Nov 03 06:05:27.707840 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:27.707448    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" event={"ID":"1f5dad80-945c-4941-81a9-94367d37de44","Type":"ContainerStarted","Data":"d519e34ca0924a6b520289f8b27b1bb63780ba375b24a0618ab0fe8c209c9316"}
Nov 03 06:05:27.748706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:27.748664    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podStartSLOduration=1.748648156 podStartE2EDuration="1.748648156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:05:27.747925327 +0000 UTC m=+615.117875413" watchObservedRunningTime="2026-11-03 06:05:27.748648156 +0000 UTC m=+615.118598243"
Nov 03 06:05:27.781598 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:27.781571    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:28.087667 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:28.087568    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:28.403988 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:05:28.403952    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:05:29.070484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.070451    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"]
Nov 03 06:05:29.074931 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.074909    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.094192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.094173    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-be1a66\"/\"kube-root-ca.crt\""
Nov 03 06:05:29.106019 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.105995    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-be1a66\"/\"openshift-service-ca.crt\""
Nov 03 06:05:29.106153 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.106040    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-be1a66\"/\"default-dockercfg-xtbd8\""
Nov 03 06:05:29.106153 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.106090    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-be1a66\"/\"premium-w4-be1a66-kserve-self-signed-certs\""
Nov 03 06:05:29.107982 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.107961    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"]
Nov 03 06:05:29.157457 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.157421    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-home\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.157588 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.157562    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29455561-7928-4756-a42c-8c2871ab2d80-tls-certs\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.157637 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.157587    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-model-cache\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.157637 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.157630    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-tmp-dir\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.157720 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.157683    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-dshm\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.157833 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.157817    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjm2h\" (UniqueName: \"kubernetes.io/projected/29455561-7928-4756-a42c-8c2871ab2d80-kube-api-access-vjm2h\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.175401 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.175369    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:29.259357 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.259317    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29455561-7928-4756-a42c-8c2871ab2d80-tls-certs\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.259579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.259373    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-model-cache\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.259579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.259431    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-tmp-dir\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.259579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.259460    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-dshm\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.259579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.259550    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjm2h\" (UniqueName: \"kubernetes.io/projected/29455561-7928-4756-a42c-8c2871ab2d80-kube-api-access-vjm2h\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.259816 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.259615    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-home\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.260613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.260270    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-home\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.260613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.260296    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-tmp-dir\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.260814 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.260619    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-model-cache\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.265772 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.265745    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-dshm\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.266162 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.266131    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29455561-7928-4756-a42c-8c2871ab2d80-tls-certs\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.283016 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.282993    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjm2h\" (UniqueName: \"kubernetes.io/projected/29455561-7928-4756-a42c-8c2871ab2d80-kube-api-access-vjm2h\") pod \"premium-w4-be1a66-kserve-847765b9f5-p7fff\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") " pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.388019 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.387988    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:29.685001 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.684975    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"]
Nov 03 06:05:29.686868 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:05:29.686841    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29455561_7928_4756_a42c_8c2871ab2d80.slice/crio-add5f3777972ff0fa211f1a847830b71af33a1226834ebd701515511c1c1319f WatchSource:0}: Error finding container add5f3777972ff0fa211f1a847830b71af33a1226834ebd701515511c1c1319f: Status 404 returned error can't find the container with id add5f3777972ff0fa211f1a847830b71af33a1226834ebd701515511c1c1319f
Nov 03 06:05:29.720577 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.720540    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" event={"ID":"29455561-7928-4756-a42c-8c2871ab2d80","Type":"ContainerStarted","Data":"add5f3777972ff0fa211f1a847830b71af33a1226834ebd701515511c1c1319f"}
Nov 03 06:05:29.728195 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:29.728172    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:30.727572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:30.727529    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" event={"ID":"29455561-7928-4756-a42c-8c2871ab2d80","Type":"ContainerStarted","Data":"946d5744cc6fc09744572b3c1b7b087aa2bd8f876dd50741466d610277229ef2"}
Nov 03 06:05:30.769636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:30.769585    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podStartSLOduration=1.769566907 podStartE2EDuration="1.769566907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:05:30.768123788 +0000 UTC m=+618.138073876" watchObservedRunningTime="2026-11-03 06:05:30.769566907 +0000 UTC m=+618.139516992"
Nov 03 06:05:31.327115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:31.327076    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:31.389059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:31.389029    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:32.931738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:32.931699    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:34.593165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:34.593130    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:36.328446 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:36.328407    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:36.783825 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:36.783795    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:36.795113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:36.795087    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:37.778395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:37.778363    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:05:38.044006 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:38.043915    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:39.388303 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:39.388271    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:39.400795 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:39.400773    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:39.618818 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:39.618784    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:39.787318 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:39.787241    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:05:41.230153 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:41.230118    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:43.119093 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:43.119058    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:44.196437 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:44.196399    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:44.746130 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:44.746098    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:46.345515 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:46.345464    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:48.244515 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:48.244458    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:49.942065 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:49.942026    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:51.574360 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:51.574326    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:53.216234 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:53.216192    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:54.261375 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:54.261344    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:54.958895 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:54.958865    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:55.626785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.626750    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"]
Nov 03 06:05:55.631861 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.631839    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.659389 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.659352    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-86728b\"/\"kube-root-ca.crt\""
Nov 03 06:05:55.659389 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.659365    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-86728b\"/\"openshift-service-ca.crt\""
Nov 03 06:05:55.659587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.659490    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-86728b\"/\"premium-w6-86728b-kserve-self-signed-certs\""
Nov 03 06:05:55.659644 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.659605    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-86728b\"/\"default-dockercfg-r27rx\""
Nov 03 06:05:55.661404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.661384    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"]
Nov 03 06:05:55.724412 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.724384    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-dshm\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.724412 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.724414    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tls-certs\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.724712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.724435    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tmp-dir\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.724712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.724630    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-model-cache\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.724810 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.724693    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-home\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.724876 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.724850    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqs7r\" (UniqueName: \"kubernetes.io/projected/b8be923f-75fc-4db1-84f7-d5347bbfe58a-kube-api-access-gqs7r\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.750864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.750829    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:55.825657 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.825624    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-model-cache\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.825894 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.825688    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-home\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.825894 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.825754    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqs7r\" (UniqueName: \"kubernetes.io/projected/b8be923f-75fc-4db1-84f7-d5347bbfe58a-kube-api-access-gqs7r\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.825894 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.825796    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-dshm\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.825894 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.825817    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tls-certs\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.825894 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.825842    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tmp-dir\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.826287 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.826266    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tmp-dir\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.826556 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.826531    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-model-cache\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.826899 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.826869    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-home\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.828955 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.828937    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-dshm\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.829428 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.829410    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tls-certs\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.849109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.849083    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqs7r\" (UniqueName: \"kubernetes.io/projected/b8be923f-75fc-4db1-84f7-d5347bbfe58a-kube-api-access-gqs7r\") pod \"premium-w6-86728b-kserve-77dd4f4499-898g9\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") " pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:55.948267 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:55.948198    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:56.246008 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:56.245933    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"]
Nov 03 06:05:56.248286 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:05:56.248259    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8be923f_75fc_4db1_84f7_d5347bbfe58a.slice/crio-fe87235bdb8285b5492a878c1ffb1836e968bfd24b680f48076881e6cbdb986f WatchSource:0}: Error finding container fe87235bdb8285b5492a878c1ffb1836e968bfd24b680f48076881e6cbdb986f: Status 404 returned error can't find the container with id fe87235bdb8285b5492a878c1ffb1836e968bfd24b680f48076881e6cbdb986f
Nov 03 06:05:56.730640 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:56.730605    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:05:56.865999 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:56.865962    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" event={"ID":"b8be923f-75fc-4db1-84f7-d5347bbfe58a","Type":"ContainerStarted","Data":"33c9dab94f0dfaf51aa1ece6d8c164ee2a8d0bd5f3ead83d7244ae61a67ac680"}
Nov 03 06:05:56.866178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:56.866008    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" event={"ID":"b8be923f-75fc-4db1-84f7-d5347bbfe58a","Type":"ContainerStarted","Data":"fe87235bdb8285b5492a878c1ffb1836e968bfd24b680f48076881e6cbdb986f"}
Nov 03 06:05:56.906565 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:56.906522    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podStartSLOduration=1.906489322 podStartE2EDuration="1.906489322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:05:56.905436911 +0000 UTC m=+644.275386995" watchObservedRunningTime="2026-11-03 06:05:56.906489322 +0000 UTC m=+644.276439406"
Nov 03 06:05:56.948706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:56.948684    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:05:58.405193 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:05:58.405158    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:05:58.534962 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:05:58.534928    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:00.328203 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:00.328173    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:02.258707 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:02.258667    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:04.208162 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:04.208126    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:04.391648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:04.391613    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:05.938615 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:05.938579    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:05.949445 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:05.949418    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:06:05.962656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:05.962579    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:06:06.932958 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:06.932929    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:06:07.750712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:07.750675    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:09.543753 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:09.543721    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:11.121723 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:11.121689    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:12.818634 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:12.818590    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:14.650058 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:14.650024    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:16.335315 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:16.335272    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:18.043105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:18.043069    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:19.634912 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:19.634875    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:21.432479 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:21.432442    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:23.254232 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:23.254199    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:25.127734 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:25.127699    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:26.776326 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:26.776293    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:28.404838 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:06:28.404806    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:06:28.561752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:28.561707    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:30.371660 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:30.371623    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:32.046677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:32.046646    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:33.741553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:33.741517    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:35.433002 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:35.432966    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:37.031517 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:37.031478    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:39.673055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:39.673025    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:40.924992 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:40.924954    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:42.899423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:42.899382    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:45.030154 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:45.030119    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:46.673987 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:46.673950    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:48.433560 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:48.433525    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:50.286008 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:50.285962    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:51.964422 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:51.964388    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:53.353367 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.353329    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"]
Nov 03 06:06:53.357084 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.357065    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.376784 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.376753    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"]
Nov 03 06:06:53.386396 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.386371    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 06:06:53.386578 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.386432    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rxh5n\""
Nov 03 06:06:53.462366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.462332    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz659\" (UniqueName: \"kubernetes.io/projected/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-kube-api-access-lz659\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.462556 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.462377    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.462556 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.462493    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.539768 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.539732    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:53.564085 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.564054    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz659\" (UniqueName: \"kubernetes.io/projected/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-kube-api-access-lz659\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.564280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.564105    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.564280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.564152    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.564960 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.564933    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.566522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.566473    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.586912 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.586889    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz659\" (UniqueName: \"kubernetes.io/projected/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-kube-api-access-lz659\") pod \"maas-api-revoke-sub-a2cad516-drw8m\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.670338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.670300    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:53.966187 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.966158    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"]
Nov 03 06:06:53.967998 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:06:53.967964    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3bc2d1_2fb5_4239_a7b3_0689c8af2f2a.slice/crio-ec33897b499da9a9382a4e502e254c5e45e3c9bf3cfc6b2fa7e03c10ed163468 WatchSource:0}: Error finding container ec33897b499da9a9382a4e502e254c5e45e3c9bf3cfc6b2fa7e03c10ed163468: Status 404 returned error can't find the container with id ec33897b499da9a9382a4e502e254c5e45e3c9bf3cfc6b2fa7e03c10ed163468
Nov 03 06:06:53.969763 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:53.969747    4418 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 06:06:54.196318 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:54.196283    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m" event={"ID":"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a","Type":"ContainerStarted","Data":"ec33897b499da9a9382a4e502e254c5e45e3c9bf3cfc6b2fa7e03c10ed163468"}
Nov 03 06:06:55.239654 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:55.239616    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:56.951576 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:56.947976    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:57.216347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:57.216258    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m" event={"ID":"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a","Type":"ContainerStarted","Data":"0cf158897996253b2d86b6acc4c0e2bd0b91edda599063dc28594df6550772de"}
Nov 03 06:06:57.257394 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:57.257339    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m" podStartSLOduration=1.8839447950000001 podStartE2EDuration="4.257315054s" totalImagesPullingTime="2.373370259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:06:57.255431811 +0000 UTC m=+704.625381896" watchObservedRunningTime="2026-11-03 06:06:57.257315054 +0000 UTC m=+704.627265151"
Nov 03 06:06:58.223150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.223117    4418 generic.go:356] "Generic (PLEG): container finished" podID="7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" containerID="0cf158897996253b2d86b6acc4c0e2bd0b91edda599063dc28594df6550772de" exitCode=0
Nov 03 06:06:58.223150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.223155    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m" event={"ID":"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a","Type":"ContainerDied","Data":"0cf158897996253b2d86b6acc4c0e2bd0b91edda599063dc28594df6550772de"}
Nov 03 06:06:58.379729 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.379694    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"]
Nov 03 06:06:58.387194 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.387168    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.402392 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.402360    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-5c3542\"/\"distinct-w2-5c3542-kserve-self-signed-certs\""
Nov 03 06:06:58.405682 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.404719    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"]
Nov 03 06:06:58.415612 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:06:58.415567    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:06:58.484616 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.484538    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:58.519116 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.519080    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-model-cache\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.519281 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.519207    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-home\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.519281 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.519260    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c341b7fe-42a9-470a-9802-b813b1dc688d-tls-certs\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.519411 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.519335    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-dshm\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.519477 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.519445    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-tmp-dir\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.519593 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.519572    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf65z\" (UniqueName: \"kubernetes.io/projected/c341b7fe-42a9-470a-9802-b813b1dc688d-kube-api-access-gf65z\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.620738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.620693    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-tmp-dir\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.620923 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.620813    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf65z\" (UniqueName: \"kubernetes.io/projected/c341b7fe-42a9-470a-9802-b813b1dc688d-kube-api-access-gf65z\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.620923 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.620900    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-model-cache\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.621028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.620953    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-home\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.621028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.620987    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c341b7fe-42a9-470a-9802-b813b1dc688d-tls-certs\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.621028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.621011    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-dshm\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.621154 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.621135    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-tmp-dir\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.621423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.621386    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-model-cache\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.621595 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.621561    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-home\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.623528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.623479    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c341b7fe-42a9-470a-9802-b813b1dc688d-tls-certs\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.623700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.623685    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-dshm\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.647119 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.647088    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf65z\" (UniqueName: \"kubernetes.io/projected/c341b7fe-42a9-470a-9802-b813b1dc688d-kube-api-access-gf65z\") pod \"distinct-w2-5c3542-kserve-7bc887699c-8cfcl\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") " pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.705121 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.705084    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:06:58.751533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:58.751396    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:06:59.009198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.009166    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"]
Nov 03 06:06:59.011037 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:06:59.011012    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc341b7fe_42a9_470a_9802_b813b1dc688d.slice/crio-1cf1f300126eda5f0ccdfb5083f203c99281d1d3c2117409200fdc9e2a08c80e WatchSource:0}: Error finding container 1cf1f300126eda5f0ccdfb5083f203c99281d1d3c2117409200fdc9e2a08c80e: Status 404 returned error can't find the container with id 1cf1f300126eda5f0ccdfb5083f203c99281d1d3c2117409200fdc9e2a08c80e
Nov 03 06:06:59.231069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.231034    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" event={"ID":"c341b7fe-42a9-470a-9802-b813b1dc688d","Type":"ContainerStarted","Data":"cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add"}
Nov 03 06:06:59.231548 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.231078    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" event={"ID":"c341b7fe-42a9-470a-9802-b813b1dc688d","Type":"ContainerStarted","Data":"1cf1f300126eda5f0ccdfb5083f203c99281d1d3c2117409200fdc9e2a08c80e"}
Nov 03 06:06:59.273099 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.272850    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podStartSLOduration=1.272833364 podStartE2EDuration="1.272833364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:06:59.270741398 +0000 UTC m=+706.640691482" watchObservedRunningTime="2026-11-03 06:06:59.272833364 +0000 UTC m=+706.642783447"
Nov 03 06:06:59.362112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.362087    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:06:59.428864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.428833    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-xks-ca\") pod \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") "
Nov 03 06:06:59.429035 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.428894    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-kube-api-access-lz659\" (UniqueName: \"kubernetes.io/projected/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-kube-api-access-lz659\") pod \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") "
Nov 03 06:06:59.429035 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.428991    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-openshift-ca\") pod \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\" (UID: \"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a\") "
Nov 03 06:06:59.429351 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.429325    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-openshift-ca" pod "7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" (UID: "7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:06:59.431022 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.431003    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-xks-ca" pod "7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" (UID: "7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:06:59.431111 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.431074    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-kube-api-access-lz659" pod "7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" (UID: "7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a"). InnerVolumeSpecName "kube-api-access-lz659". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:06:59.530546 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.530457    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-xks-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:06:59.530546 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.530486    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz659\" (UniqueName: \"kubernetes.io/projected/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-kube-api-access-lz659\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:06:59.530546 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.530496    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a-maas-api-openshift-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:06:59.706521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:06:59.705205    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:07:00.237324 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:00.237293    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"
Nov 03 06:07:00.237324 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:00.237316    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m" event={"ID":"7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a","Type":"ContainerDied","Data":"ec33897b499da9a9382a4e502e254c5e45e3c9bf3cfc6b2fa7e03c10ed163468"}
Nov 03 06:07:00.237776 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:00.237362    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec33897b499da9a9382a4e502e254c5e45e3c9bf3cfc6b2fa7e03c10ed163468"
Nov 03 06:07:00.437446 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:00.437413    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:02.149176 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:02.149141    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:04.517525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:04.517061    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:04.846728 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:04.846643    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:06.515217 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:06.515177    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:08.236867 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.236832    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:08.705327 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.705293    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:07:08.718774 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.718747    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:07:08.824209 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.824175    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"]
Nov 03 06:07:08.824733 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.824714    4418 cpu_manager.go:414] "containerMap: removing container" podUID="7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" containerName="revoke-keys"
Nov 03 06:07:08.824733 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.824734    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" containerName="revoke-keys"
Nov 03 06:07:08.824862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.824842    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" containerName="revoke-keys"
Nov 03 06:07:08.828394 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.828376    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.845530 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.845486    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-9688d8-openshift-default-dockercfg-ldnhj\""
Nov 03 06:07:08.857540 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.857517    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"]
Nov 03 06:07:08.932329 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932295    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhn9k\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-kube-api-access-nhn9k\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932352    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932459    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932588    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932631    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932655    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932783 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932670    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932783 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932740    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:08.932905 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:08.932885    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/250ee13c-bd92-41b7-aa11-72ea0d25395b-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.033823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033742    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.033823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033802    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033832    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033852    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033868    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033895    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033947    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/250ee13c-bd92-41b7-aa11-72ea0d25395b-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.033981    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhn9k\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-kube-api-access-nhn9k\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.034015    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034376 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.034228    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034376 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.034312    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034493 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.034382    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034592 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.034548    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.034764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.034743    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/250ee13c-bd92-41b7-aa11-72ea0d25395b-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.036165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.036145    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.036268 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.036212    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.056417 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.056391    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.056574 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.056556    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhn9k\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-kube-api-access-nhn9k\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.141295 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.141270    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:09.298454 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.298379    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:07:09.457043 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.457015    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"]
Nov 03 06:07:09.458876 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:09.458852    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250ee13c_bd92_41b7_aa11_72ea0d25395b.slice/crio-1e1f49b23008b71da01789f914529bda1086bd2c5d7e839366db0222331b22e3 WatchSource:0}: Error finding container 1e1f49b23008b71da01789f914529bda1086bd2c5d7e839366db0222331b22e3: Status 404 returned error can't find the container with id 1e1f49b23008b71da01789f914529bda1086bd2c5d7e839366db0222331b22e3
Nov 03 06:07:09.461169 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.461138    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:09.461257 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.461200    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:09.461257 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:09.461229    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:10.024672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:10.024633    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:10.302123 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:10.302030    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" event={"ID":"250ee13c-bd92-41b7-aa11-72ea0d25395b","Type":"ContainerStarted","Data":"f76126853a953bf177f5f77ce65d91e75a2ab40c8f9434846aaf4df26317dde1"}
Nov 03 06:07:10.302123 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:10.302092    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" event={"ID":"250ee13c-bd92-41b7-aa11-72ea0d25395b","Type":"ContainerStarted","Data":"1e1f49b23008b71da01789f914529bda1086bd2c5d7e839366db0222331b22e3"}
Nov 03 06:07:10.371365 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:10.371314    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podStartSLOduration=2.371294093 podStartE2EDuration="2.371294093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:10.358667603 +0000 UTC m=+717.728617691" watchObservedRunningTime="2026-11-03 06:07:10.371294093 +0000 UTC m=+717.741244211"
Nov 03 06:07:11.142120 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:11.142084    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:11.143586 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:11.143566    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 03 06:07:11.143651 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:11.143612    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 03 06:07:11.798525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:11.797778    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:12.142426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:12.142388    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 03 06:07:12.142628 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:12.142445    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 03 06:07:13.142205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:13.142172    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 03 06:07:13.142667 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:13.142240    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 03 06:07:13.433143 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:13.433066    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:14.141713 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:14.141679    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 03 06:07:14.141892 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:14.141761    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 03 06:07:15.141762 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:15.141721    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Nov 03 06:07:15.142252 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:15.141788    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Nov 03 06:07:15.241071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:15.241040    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:16.175145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:16.175093    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:16.175789 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:16.175766    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:16.178069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:16.178017    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:07:17.019706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:17.019660    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:18.198044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:18.198012    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:19.497591 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:19.497558    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:21.244968 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:21.244913    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:22.954880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:22.954844    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:24.237267 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.237237    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"]
Nov 03 06:07:24.242034 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.242015    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.257387 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.257364    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-86728b-openshift-default-dockercfg-kswxd\""
Nov 03 06:07:24.271536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.271514    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"]
Nov 03 06:07:24.292152 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.292120    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"]
Nov 03 06:07:24.296933 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.296908    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311122 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311100    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311130    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311149    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bf9f7a-e132-446b-a527-a69f8885aceb-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311172    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311264    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plnvc\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-kube-api-access-plnvc\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311311    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311355    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311420    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311452    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311469    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311595 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311545    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311595 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311570    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311657 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311621    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nbxl\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-kube-api-access-7nbxl\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311657 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311645    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311721 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311680    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311721 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311695    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.311808 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311791    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.311903 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.311888    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.318687 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.318669    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"]
Nov 03 06:07:24.358349 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.358324    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-ba6892-openshift-default-dockercfg-mtf55\""
Nov 03 06:07:24.412824 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412797    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.412824 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412825    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412847    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412862    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412878    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412927    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412955    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.412987    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nbxl\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-kube-api-access-7nbxl\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413064    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413122    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413156    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413209    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413279    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413285    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413349    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413380    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413407    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413411    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bf9f7a-e132-446b-a527-a69f8885aceb-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413442    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413495    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413548    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plnvc\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-kube-api-access-plnvc\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.413648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413622    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.414072 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413782    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.414072 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413928    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.414072 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.413987    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.414208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.414074    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.414208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.414084    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bf9f7a-e132-446b-a527-a69f8885aceb-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.414300 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.414279    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.415309 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.415278    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.415755 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.415734    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.416038 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.416019    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.416378 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.416363    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.435214 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.435191    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.435824 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.435807    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plnvc\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-kube-api-access-plnvc\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.435940 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.435923    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.436410 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.436388    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nbxl\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-kube-api-access-7nbxl\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.551310 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.551220    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"]
Nov 03 06:07:24.554852 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.554633    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:24.557053 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.556600    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.564783 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.564744    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:24.576144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.576108    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-b7e447-openshift-default-dockercfg-slpt8\""
Nov 03 06:07:24.579863 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.579794    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"]
Nov 03 06:07:24.612051 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.611826    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:24.615285 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615257    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615364    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8rsd\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-kube-api-access-j8rsd\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615452 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615417    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615465    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08a35ec3-7700-4282-ac87-050323cec75e-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615525    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615558    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08a35ec3-7700-4282-ac87-050323cec75e-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615617    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615657    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.615820 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.615725    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717292 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717259    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717306    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8rsd\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-kube-api-access-j8rsd\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717353    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717381    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08a35ec3-7700-4282-ac87-050323cec75e-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717402    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717429    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08a35ec3-7700-4282-ac87-050323cec75e-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717479    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717520    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.717700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.717587    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.720583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.719464    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.720583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.720104    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08a35ec3-7700-4282-ac87-050323cec75e-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.720583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.720155    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.720583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.720214    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.720583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.720213    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.720920 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.720904    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.722359 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.722337    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08a35ec3-7700-4282-ac87-050323cec75e-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.740094 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.740065    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.740468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.740445    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8rsd\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-kube-api-access-j8rsd\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.880207 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.880184    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"]
Nov 03 06:07:24.882175 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:24.882150    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ff3960_8e55_4cc1_920c_ca62c7e76e16.slice/crio-bcf2540f4d850f98e6d2e6b4f5c41ac75ff3d30ab9bd8c3beddb216d5dd2d015 WatchSource:0}: Error finding container bcf2540f4d850f98e6d2e6b4f5c41ac75ff3d30ab9bd8c3beddb216d5dd2d015: Status 404 returned error can't find the container with id bcf2540f4d850f98e6d2e6b4f5c41ac75ff3d30ab9bd8c3beddb216d5dd2d015
Nov 03 06:07:24.884569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.884534    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:24.884653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.884603    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:24.884653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.884631    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:24.885022 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.885002    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:24.937055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.937030    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"]
Nov 03 06:07:24.941224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.941179    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:24.941552 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.941527    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:24.941709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:24.941690    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:25.200591 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.200554    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"]
Nov 03 06:07:25.202193 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:25.202165    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a35ec3_7700_4282_ac87_050323cec75e.slice/crio-d66bfe66598ed9876ca3214f949adf7147ff76e34451542b135e1f08e1ff9d14 WatchSource:0}: Error finding container d66bfe66598ed9876ca3214f949adf7147ff76e34451542b135e1f08e1ff9d14: Status 404 returned error can't find the container with id d66bfe66598ed9876ca3214f949adf7147ff76e34451542b135e1f08e1ff9d14
Nov 03 06:07:25.204870 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.204842    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:25.204954 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.204908    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:25.204954 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.204938    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:25.389941 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.389905    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" event={"ID":"08a35ec3-7700-4282-ac87-050323cec75e","Type":"ContainerStarted","Data":"00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57"}
Nov 03 06:07:25.390538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.390475    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" event={"ID":"08a35ec3-7700-4282-ac87-050323cec75e","Type":"ContainerStarted","Data":"d66bfe66598ed9876ca3214f949adf7147ff76e34451542b135e1f08e1ff9d14"}
Nov 03 06:07:25.391783 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.391741    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" event={"ID":"84bf9f7a-e132-446b-a527-a69f8885aceb","Type":"ContainerStarted","Data":"832e5c4c3745142d92e6f23b7776c7b35dae3c3e36292dd5454630cdb9a33895"}
Nov 03 06:07:25.391885 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.391786    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" event={"ID":"84bf9f7a-e132-446b-a527-a69f8885aceb","Type":"ContainerStarted","Data":"16629bd916d24750242844a386e6a09d2aa8f4fc2385687bc620cb9d16fa9489"}
Nov 03 06:07:25.393773 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.393752    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" event={"ID":"90ff3960-8e55-4cc1-920c-ca62c7e76e16","Type":"ContainerStarted","Data":"970ddb85c37e09312b83154cfdf77af1341fecd9de0d53ee81f0dafccc5f80a5"}
Nov 03 06:07:25.393902 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.393792    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" event={"ID":"90ff3960-8e55-4cc1-920c-ca62c7e76e16","Type":"ContainerStarted","Data":"bcf2540f4d850f98e6d2e6b4f5c41ac75ff3d30ab9bd8c3beddb216d5dd2d015"}
Nov 03 06:07:25.436305 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.436253    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podStartSLOduration=1.436236171 podStartE2EDuration="1.436236171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:25.434374603 +0000 UTC m=+732.804324689" watchObservedRunningTime="2026-11-03 06:07:25.436236171 +0000 UTC m=+732.806186255"
Nov 03 06:07:25.481738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.481639    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podStartSLOduration=1.481625502 podStartE2EDuration="1.481625502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:25.478841241 +0000 UTC m=+732.848791346" watchObservedRunningTime="2026-11-03 06:07:25.481625502 +0000 UTC m=+732.851575586"
Nov 03 06:07:25.527544 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.527263    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podStartSLOduration=1.5272451729999998 podStartE2EDuration="1.527245173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:25.52401521 +0000 UTC m=+732.893965316" watchObservedRunningTime="2026-11-03 06:07:25.527245173 +0000 UTC m=+732.897195260"
Nov 03 06:07:25.555466 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.555425    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:25.557415 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.557378    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:25.557568 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.557429    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:25.612858 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.612831    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:25.888524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:25.887636    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:26.329146 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.328941    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:26.556361 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.556330    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:26.556966 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.556933    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:26.609996 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.596981    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"]
Nov 03 06:07:26.609996 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.603868    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.648525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.648172    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"]
Nov 03 06:07:26.684251 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.684221    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 03 06:07:26.684474 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.684447    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 03 06:07:26.707527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.688428    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.731752    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.731812    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.731882    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.731925    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhk4\" (UniqueName: \"kubernetes.io/projected/cf338851-2cf1-467e-9683-c5e6bfd65843-kube-api-access-mmhk4\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.731984    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.732043    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.732114    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf338851-2cf1-467e-9683-c5e6bfd65843-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.735526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.732188    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.850578 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.850540    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.850858 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.850841    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.850987 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.850974    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.851078 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.851065    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.851203 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.851190    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.851308 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.851287    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhk4\" (UniqueName: \"kubernetes.io/projected/cf338851-2cf1-467e-9683-c5e6bfd65843-kube-api-access-mmhk4\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.851440 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.851428    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.851587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.851572    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.851730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.851718    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf338851-2cf1-467e-9683-c5e6bfd65843-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.852636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.852613    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf338851-2cf1-467e-9683-c5e6bfd65843-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.853044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.853014    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-credential-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.861017 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.860955    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-data\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.861146 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.861130    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-workload-certs\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.861800 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.861768    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-workload-socket\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.862527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.862479    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-envoy\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.863715 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.863695    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-podinfo\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.951744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.951714    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf338851-2cf1-467e-9683-c5e6bfd65843-istio-token\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:26.957653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.957612    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 06:07:26.957917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.957870    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 06:07:26.967385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:26.967362    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhk4\" (UniqueName: \"kubernetes.io/projected/cf338851-2cf1-467e-9683-c5e6bfd65843-kube-api-access-mmhk4\") pod \"maas-default-gateway-openshift-default-778b7b5c47-27zsf\" (UID: \"cf338851-2cf1-467e-9683-c5e6bfd65843\") " pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:27.067280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.067253    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:27.559206 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.559098    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:27.559206 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.559163    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:27.567862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.565880    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"]
Nov 03 06:07:27.567862 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:27.567766    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf338851_2cf1_467e_9683_c5e6bfd65843.slice/crio-909ef46f13cc623b1f87392262c2c9e211833cb0a3eeb3912d99473ea7f359b1 WatchSource:0}: Error finding container 909ef46f13cc623b1f87392262c2c9e211833cb0a3eeb3912d99473ea7f359b1: Status 404 returned error can't find the container with id 909ef46f13cc623b1f87392262c2c9e211833cb0a3eeb3912d99473ea7f359b1
Nov 03 06:07:27.571769 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.571741    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:27.571854 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.571799    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:27.571854 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.571827    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:27.624027 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.623712    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 03 06:07:27.624027 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.623770    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 03 06:07:27.886573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.886530    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 06:07:27.886814 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:27.886768    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 06:07:28.055108 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.055075    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:28.475537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.473597    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" event={"ID":"cf338851-2cf1-467e-9683-c5e6bfd65843","Type":"ContainerStarted","Data":"88b0832974f7b9f25c76be6c5894917a0c3b9d53b708556e085c2e95fc1b60fb"}
Nov 03 06:07:28.475537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.473694    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" event={"ID":"cf338851-2cf1-467e-9683-c5e6bfd65843","Type":"ContainerStarted","Data":"909ef46f13cc623b1f87392262c2c9e211833cb0a3eeb3912d99473ea7f359b1"}
Nov 03 06:07:28.550701 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:07:28.550663    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:07:28.560198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.559886    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:28.560198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.559942    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:28.614812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.614770    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 03 06:07:28.615121 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.615096    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 03 06:07:28.889639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.885882    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 06:07:28.889639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:28.885972    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 06:07:29.068807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.068770    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:29.070825 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.070788    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:29.071056 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.071030    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:29.559390 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.558950    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:29.559390 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.559012    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:29.615256 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.614854    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 03 06:07:29.615256 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.614912    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 03 06:07:29.870961 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.870932    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:29.886759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.886726    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 06:07:29.887150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:29.887120    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 06:07:30.073524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.069000    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:30.073524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.069073    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:30.197066 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.196975    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:30.558880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.558769    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:30.559130 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.559096    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:30.616523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.616303    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 03 06:07:30.616523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.616398    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 03 06:07:30.885651 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.885616    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 06:07:30.886750 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:30.886708    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 06:07:31.072940 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.072901    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:31.073210 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.073181    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:31.564526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.560619    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:31.564526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.562291    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:31.564526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.562338    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:31.568529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.565955    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:31.622183 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.622150    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 03 06:07:31.622773 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.622741    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 03 06:07:31.643639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.643586    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Nov 03 06:07:31.775690 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.775633    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:31.790672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.790627    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:31.886533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.885981    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 06:07:31.886533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.886054    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 06:07:31.937637 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:31.937588    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:32.068538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.068101    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:32.068538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.068175    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:32.295825 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.295020    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:32.351143 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.347659    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:32.557587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.557342    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Nov 03 06:07:32.558286 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.557806    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Nov 03 06:07:32.618526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.617898    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Nov 03 06:07:32.618526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.617975    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Nov 03 06:07:32.887523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.886005    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 06:07:32.887523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:32.886117    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 06:07:33.070676 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:33.070636    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:33.070949 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:33.070915    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:34.068356 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.068321    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:34.068993 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.068958    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:34.128109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.128076    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:34.530854 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.530820    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:34.533526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.532391    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:34.552110 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.552065    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:07:34.602525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.601755    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:07:34.602525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.601822    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:34.621555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.620745    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podStartSLOduration=8.620726369 podStartE2EDuration="8.620726369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:28.551222129 +0000 UTC m=+735.921172214" watchObservedRunningTime="2026-11-03 06:07:34.620726369 +0000 UTC m=+741.990676455"
Nov 03 06:07:34.628627 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.628599    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:07:34.628838 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.628813    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:07:34.645861 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.645833    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:34.646764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.646744    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:34.647692 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.647675    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:07:34.977797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.977768    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:34.979345 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.979321    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:34.991810 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:34.991785    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:07:35.068804 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:35.068774    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:35.069190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:35.068830    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:35.827647 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:35.827610    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:36.069004 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:36.068972    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-27zsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 06:07:36.069367 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:36.069023    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf" podUID="cf338851-2cf1-467e-9683-c5e6bfd65843" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 06:07:37.532157 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:37.532127    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:37.853382 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:37.853295    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:37.853802 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:37.853782    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:37.854687 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:37.854671    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-27zsf"
Nov 03 06:07:38.577833 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.577795    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"]
Nov 03 06:07:38.585268 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.585245    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.599632 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.599614    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-5c3542-openshift-default-dockercfg-mhnlv\""
Nov 03 06:07:38.614862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.614840    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"]
Nov 03 06:07:38.685385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685349    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685412    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685592 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685553    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685592 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685576    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0e000f-af9e-4fac-b314-169098cd5df9-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685688 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685619    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685772 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685754    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685833 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685805    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685908    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.685982 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.685947    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g248\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-kube-api-access-2g248\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.727806 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.727780    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"]
Nov 03 06:07:38.731666 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.731649    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.746228 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.746210    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-df7236-openshift-default-dockercfg-qtf5v\""
Nov 03 06:07:38.755341 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.755315    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"]
Nov 03 06:07:38.787603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787579    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.787764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787608    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0e000f-af9e-4fac-b314-169098cd5df9-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.787764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787643    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.787764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787674    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.787764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787700    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.787764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787740    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.787764 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787765    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g248\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-kube-api-access-2g248\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.788071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787821    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.788071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.787848    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.788071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.788031    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.788225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.788075    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.788731 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.788704    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0e000f-af9e-4fac-b314-169098cd5df9-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.788834 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.788815    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.788922 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.788901    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.790722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.790699    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.791006 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.790986    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.810837 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.810805    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.811004 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.810989    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g248\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-kube-api-access-2g248\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.889030 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889001    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889135    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b4ea53-0f14-4371-807d-809bb5d5b956-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889204 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889175    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpdvq\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-kube-api-access-kpdvq\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889270 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889249    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889459 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889384    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889459 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889422    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889654 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889540    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889721 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889665    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.889721 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.889705    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.898840 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.898820    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:38.922959 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.922936    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"]
Nov 03 06:07:38.927133 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.927114    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:38.962581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.962555    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"]
Nov 03 06:07:38.991268 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991240    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991402 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991276    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991402 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991346    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991478 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991401    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b4ea53-0f14-4371-807d-809bb5d5b956-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991478 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991425    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpdvq\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-kube-api-access-kpdvq\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991478 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991442    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991478 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991472    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991647 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991487    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.991647 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.991540    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.992079 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.992060    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.992259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.992245    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.992815 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.992792    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.992941 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.992918    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.993280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.993255    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b4ea53-0f14-4371-807d-809bb5d5b956-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.994423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.994405    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:38.995001 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:38.994985    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:39.014679 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.014655    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:39.014967 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.014949    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpdvq\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-kube-api-access-kpdvq\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:39.044825 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.044797    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:39.093180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093147    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093269    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q8g\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-kube-api-access-24q8g\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093325    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093466 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093352    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093466 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093382    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faccdd52-4e72-4255-94ad-f126db8baa72-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093466 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093412    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faccdd52-4e72-4255-94ad-f126db8baa72-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093466    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093512    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.093597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.093538    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.194942 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.194860    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.194942 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.194896    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.194942 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.194914    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.194983    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195059    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q8g\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-kube-api-access-24q8g\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195115    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195147    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195173    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faccdd52-4e72-4255-94ad-f126db8baa72-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195202    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faccdd52-4e72-4255-94ad-f126db8baa72-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195520 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195292    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195520 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195423    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195634    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195702 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195666    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.195946 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.195926    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faccdd52-4e72-4255-94ad-f126db8baa72-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.197148 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.197131    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.197549 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.197532    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faccdd52-4e72-4255-94ad-f126db8baa72-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.217656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.217633    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.218176 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.218156    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q8g\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-kube-api-access-24q8g\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.223613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.223596    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"]
Nov 03 06:07:39.225634 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:39.225614    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0e000f_af9e_4fac_b314_169098cd5df9.slice/crio-8cb84d03b2bb5b4fd565066d0cd5c51b9f1702ead912e4dfdfacbd418a9a4527 WatchSource:0}: Error finding container 8cb84d03b2bb5b4fd565066d0cd5c51b9f1702ead912e4dfdfacbd418a9a4527: Status 404 returned error can't find the container with id 8cb84d03b2bb5b4fd565066d0cd5c51b9f1702ead912e4dfdfacbd418a9a4527
Nov 03 06:07:39.227965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.227934    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.228073 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.228010    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.228073 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.228054    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.232314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.232287    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:39.243393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.243374    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:39.351342 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.351294    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"]
Nov 03 06:07:39.354936 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:39.354908    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b4ea53_0f14_4371_807d_809bb5d5b956.slice/crio-dc7c3d35a7141726c74b0b614533b952d386e43b38b0851c8ce7e9ca5255048c WatchSource:0}: Error finding container dc7c3d35a7141726c74b0b614533b952d386e43b38b0851c8ce7e9ca5255048c: Status 404 returned error can't find the container with id dc7c3d35a7141726c74b0b614533b952d386e43b38b0851c8ce7e9ca5255048c
Nov 03 06:07:39.358461 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.358427    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.358569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.358496    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.358569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.358553    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.573961 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.573928    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"]
Nov 03 06:07:39.575435 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:39.575407    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaccdd52_4e72_4255_94ad_f126db8baa72.slice/crio-eff3966da29379588ad2cb461e313af24434267ff5059463da3ab67eb28d8820 WatchSource:0}: Error finding container eff3966da29379588ad2cb461e313af24434267ff5059463da3ab67eb28d8820: Status 404 returned error can't find the container with id eff3966da29379588ad2cb461e313af24434267ff5059463da3ab67eb28d8820
Nov 03 06:07:39.578278 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.578245    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.578722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.578322    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.578722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.578370    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:39.605718 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.605677    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" event={"ID":"e7b4ea53-0f14-4371-807d-809bb5d5b956","Type":"ContainerStarted","Data":"02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9"}
Nov 03 06:07:39.605867 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.605743    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" event={"ID":"e7b4ea53-0f14-4371-807d-809bb5d5b956","Type":"ContainerStarted","Data":"dc7c3d35a7141726c74b0b614533b952d386e43b38b0851c8ce7e9ca5255048c"}
Nov 03 06:07:39.607801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.607760    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" event={"ID":"faccdd52-4e72-4255-94ad-f126db8baa72","Type":"ContainerStarted","Data":"eff3966da29379588ad2cb461e313af24434267ff5059463da3ab67eb28d8820"}
Nov 03 06:07:39.609760 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.609732    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" event={"ID":"bc0e000f-af9e-4fac-b314-169098cd5df9","Type":"ContainerStarted","Data":"5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a"}
Nov 03 06:07:39.609898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.609785    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" event={"ID":"bc0e000f-af9e-4fac-b314-169098cd5df9","Type":"ContainerStarted","Data":"8cb84d03b2bb5b4fd565066d0cd5c51b9f1702ead912e4dfdfacbd418a9a4527"}
Nov 03 06:07:39.699600 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.699532    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podStartSLOduration=1.699494595 podStartE2EDuration="1.699494595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:39.69654512 +0000 UTC m=+747.066495207" watchObservedRunningTime="2026-11-03 06:07:39.699494595 +0000 UTC m=+747.069444680"
Nov 03 06:07:39.700971 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.700584    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podStartSLOduration=1.700571678 podStartE2EDuration="1.700571678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:39.653486712 +0000 UTC m=+747.023436796" watchObservedRunningTime="2026-11-03 06:07:39.700571678 +0000 UTC m=+747.070521761"
Nov 03 06:07:39.916645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:39.916605    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:40.046010 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.045975    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:40.047772 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.047745    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 06:07:40.047968 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.047945    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 06:07:40.508522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.507933    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:40.639531 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.636489    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" event={"ID":"faccdd52-4e72-4255-94ad-f126db8baa72","Type":"ContainerStarted","Data":"0cd9d323ac1b5fe9d84784715a637586aa6d8905ea506e450b9f5731bb7047cc"}
Nov 03 06:07:40.713664 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.711583    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podStartSLOduration=2.6984861909999998 podStartE2EDuration="2.698486191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:40.697835892 +0000 UTC m=+748.067785977" watchObservedRunningTime="2026-11-03 06:07:40.698486191 +0000 UTC m=+748.068436279"
Nov 03 06:07:40.914291 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.914255    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 06:07:40.914569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:40.914542    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 06:07:41.051936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.051899    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 06:07:41.052214 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.052186    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 06:07:41.154310 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.154270    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:41.248685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.248592    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:41.249063 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.249040    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 06:07:41.249274 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.249240    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 06:07:41.903539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.902829    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 06:07:41.903539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:41.902897    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 06:07:42.051527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:42.048995    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 06:07:42.051527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:42.049072    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 06:07:42.245579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:42.244968    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 06:07:42.245579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:42.245044    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 06:07:42.907524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:42.900008    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 06:07:42.907524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:42.900067    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 06:07:42.963625 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:42.963569    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:43.052526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:43.051360    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 06:07:43.052526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:43.051419    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 06:07:43.244889 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:43.244807    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 06:07:43.245152 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:43.245123    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 06:07:43.837225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:43.772203    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:43.902535 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:43.901674    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 06:07:43.902535 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:43.901745    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 06:07:44.055464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:44.054972    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 06:07:44.055464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:44.055035    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 06:07:44.244523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:44.244247    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 06:07:44.244523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:44.244406    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 06:07:44.888525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:44.888257    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:44.913525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:44.904904    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 06:07:44.913525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:44.904967    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 06:07:45.056622 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:45.052930    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 06:07:45.056622 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:45.052990    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 06:07:45.247293 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:45.246829    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 06:07:45.247293 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:45.246888    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 06:07:45.536354 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:45.533469    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:45.899951 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:45.899911    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 06:07:45.900221 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:45.900188    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 06:07:46.045711 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.045673    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 06:07:46.045901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.045745    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 06:07:46.244047 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.243952    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 06:07:46.244542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.244034    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 06:07:46.655027 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.654966    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:46.950699 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.950621    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:46.951078 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.951056    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:46.952301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:46.952280    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:07:47.050645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:47.050614    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:47.051005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:47.050971    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:47.052086 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:47.052066    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:07:47.248399 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:47.248325    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:47.248785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:47.248633    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:47.249448 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:47.249428    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:07:48.548304 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:48.548272    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:50.605084 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:50.605005    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:52.464542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:52.464478    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:52.621331 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:52.621299    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:54.065481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.065449    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"]
Nov 03 06:07:54.070460 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.070438    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089436 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089410    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q246k\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-kube-api-access-q246k\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089566 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089465    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089566 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089539    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089668 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089643    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089684    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089739 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089716    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089825 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089810    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089869    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.089916 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.089903    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.101036 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.101009    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"]
Nov 03 06:07:54.172148 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.172121    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-be1a66-openshift-default-dockercfg-kn8kd\""
Nov 03 06:07:54.190948 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.190901    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.190948 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.190953    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191159 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.190978    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191159 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191015    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191159 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191046    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191159 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191089    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191363 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191267    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q246k\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-kube-api-access-q246k\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191363 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191338    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191364    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191386    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191715 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191360    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191715 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191632    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.191807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.191776    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.192067 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.192047    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.193379 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.193357    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.193599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.193582    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.213948 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.213926    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.214085 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.214068    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q246k\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-kube-api-access-q246k\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.292550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.292512    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:54.385294 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.385264    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:54.708734 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.708705    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"]
Nov 03 06:07:54.709690 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:07:54.709664    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a93263_1fc0_4249_a4c4_7dac8a90af34.slice/crio-5694d7465b12b355299b33020efd5d1b74ec4e830d50f1d2688f0e00cf549475 WatchSource:0}: Error finding container 5694d7465b12b355299b33020efd5d1b74ec4e830d50f1d2688f0e00cf549475: Status 404 returned error can't find the container with id 5694d7465b12b355299b33020efd5d1b74ec4e830d50f1d2688f0e00cf549475
Nov 03 06:07:54.712201 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.712172    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:54.712280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.712230    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:54.712280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:54.712266    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:07:55.144958 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:55.144924    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" event={"ID":"b7a93263-1fc0-4249-a4c4-7dac8a90af34","Type":"ContainerStarted","Data":"481c87ead7840582c6227e1d06008c25afaf8b0232452a2d3e4b46d32d28440d"}
Nov 03 06:07:55.145349 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:55.144974    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" event={"ID":"b7a93263-1fc0-4249-a4c4-7dac8a90af34","Type":"ContainerStarted","Data":"5694d7465b12b355299b33020efd5d1b74ec4e830d50f1d2688f0e00cf549475"}
Nov 03 06:07:55.217366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:55.217315    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podStartSLOduration=1.217297457 podStartE2EDuration="1.217297457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:07:55.203468885 +0000 UTC m=+762.573418970" watchObservedRunningTime="2026-11-03 06:07:55.217297457 +0000 UTC m=+762.587247532"
Nov 03 06:07:55.393537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:55.388157    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:07:55.393537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:55.388288    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 06:07:55.393537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:55.388338    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 06:07:56.080551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:56.080515    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:56.397653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:56.397612    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 06:07:56.398080 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:56.397683    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 06:07:57.386971 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:57.386929    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 06:07:57.387278 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:57.387247    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 06:07:57.855732 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:57.855652    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:07:58.397635 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:58.397599    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 06:07:58.397934 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:58.397906    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 06:07:58.424485 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:07:58.424448    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:07:59.388957 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:59.388919    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 06:07:59.390965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:59.390932    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 06:07:59.653524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:07:59.653414    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:00.394669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:00.394632    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 06:08:00.395277 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:00.395245    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 06:08:01.446337 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:01.446297    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:01.570192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:01.570154    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:08:01.570459 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:01.570439    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:08:01.574154 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:01.574127    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:08:03.128288 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:03.128252    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:04.644712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:04.644674    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:04.819814 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:04.819780    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:06.321843 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:06.321805    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:08.415344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:08.415298    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:10.226864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:10.226822    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:11.628571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.628533    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"]
Nov 03 06:08:11.634338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.634312    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.650328 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.650304    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-ba6892\"/\"openshift-service-ca.crt\""
Nov 03 06:08:11.650845 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.650822    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-ba6892\"/\"kube-root-ca.crt\""
Nov 03 06:08:11.662380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.662346    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-ba6892\"/\"distinct-2-w5-ba6892-kserve-self-signed-certs\""
Nov 03 06:08:11.662566 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.662460    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-ba6892\"/\"default-dockercfg-v45nf\""
Nov 03 06:08:11.667879 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.667854    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"]
Nov 03 06:08:11.744562 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.744512    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tmp-dir\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.744760 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.744587    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-home\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.744760 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.744608    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8rh\" (UniqueName: \"kubernetes.io/projected/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-kube-api-access-wc8rh\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.744760 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.744707    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tls-certs\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.744760 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.744753    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-dshm\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.744982 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.744846    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-model-cache\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.750756 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.750721    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:11.846173 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.846130    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tmp-dir\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.846391 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.846189    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-home\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.846391 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.846214    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8rh\" (UniqueName: \"kubernetes.io/projected/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-kube-api-access-wc8rh\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.846391 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.846296    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tls-certs\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.846580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.846398    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-dshm\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.846580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.846478    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-model-cache\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.846814 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.846790    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-home\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.848024 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.847970    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-model-cache\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.848635 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.848615    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tmp-dir\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.852975 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.852949    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tls-certs\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.871131 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.869412    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-dshm\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.872589 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.872542    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8rh\" (UniqueName: \"kubernetes.io/projected/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-kube-api-access-wc8rh\") pod \"distinct-2-w5-ba6892-kserve-cbf76df79-455gt\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") " pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:11.950757 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:11.950667    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:12.217198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:12.217054    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:12.280273 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:12.280252    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"]
Nov 03 06:08:12.282689 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:08:12.282666    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6f614c3_4bac_48bb_9edb_a60166b5a4fb.slice/crio-e81a98e83fff9994dad34e29e219ca90f168e19cd26c43370756e71693b08837 WatchSource:0}: Error finding container e81a98e83fff9994dad34e29e219ca90f168e19cd26c43370756e71693b08837: Status 404 returned error can't find the container with id e81a98e83fff9994dad34e29e219ca90f168e19cd26c43370756e71693b08837
Nov 03 06:08:13.287293 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:13.287250    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" event={"ID":"b6f614c3-4bac-48bb-9edb-a60166b5a4fb","Type":"ContainerStarted","Data":"30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3"}
Nov 03 06:08:13.287846 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:13.287301    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" event={"ID":"b6f614c3-4bac-48bb-9edb-a60166b5a4fb","Type":"ContainerStarted","Data":"e81a98e83fff9994dad34e29e219ca90f168e19cd26c43370756e71693b08837"}
Nov 03 06:08:13.330285 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:13.330224    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podStartSLOduration=2.330205662 podStartE2EDuration="2.330205662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:08:13.327041946 +0000 UTC m=+780.696992030" watchObservedRunningTime="2026-11-03 06:08:13.330205662 +0000 UTC m=+780.700155752"
Nov 03 06:08:13.951603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:13.951569    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:14.055334 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:14.055294    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:15.765134 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:15.765081    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:17.497190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:17.497141    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:19.130091 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:19.130052    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:20.318021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:20.317985    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:21.037620 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:21.037583    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:21.951141 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:21.951108    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:21.964482 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:21.964454    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:22.354465 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:22.354384    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:22.841288 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:22.841247    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:23.017477 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:23.017348    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:24.723452 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:24.723411    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:26.457205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:26.457169    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:28.013411 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.013373    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"]
Nov 03 06:08:28.019279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.019258    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.035593 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.035569    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-df7236\"/\"openshift-service-ca.crt\""
Nov 03 06:08:28.047589 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.047566    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-df7236\"/\"kube-root-ca.crt\""
Nov 03 06:08:28.047750 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.047582    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-df7236\"/\"default-dockercfg-9pvnm\""
Nov 03 06:08:28.047750 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.047583    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-df7236\"/\"distinct-2-w0-df7236-kserve-self-signed-certs\""
Nov 03 06:08:28.052303 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.052276    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"]
Nov 03 06:08:28.122341 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.122301    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:28.149155 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.149123    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-dshm\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.149346 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.149249    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-model-cache\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.149346 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.149326    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-home\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.149471 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.149425    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-tmp-dir\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.149546 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.149485    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776dbac9-7c0a-47b2-a2b4-eaf723467109-tls-certs\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.149610 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.149544    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fdc9\" (UniqueName: \"kubernetes.io/projected/776dbac9-7c0a-47b2-a2b4-eaf723467109-kube-api-access-2fdc9\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.251230 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.251194    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776dbac9-7c0a-47b2-a2b4-eaf723467109-tls-certs\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.251439 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.251273    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fdc9\" (UniqueName: \"kubernetes.io/projected/776dbac9-7c0a-47b2-a2b4-eaf723467109-kube-api-access-2fdc9\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.251439 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.251370    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-dshm\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.251608 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.251461    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-model-cache\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.251608 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.251570    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-home\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.251714 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.251614    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-tmp-dir\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.252136 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.252045    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-tmp-dir\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.252136 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.252089    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-home\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.252308 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.252231    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-model-cache\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.253695 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.253672    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-dshm\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.254199 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.254180    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776dbac9-7c0a-47b2-a2b4-eaf723467109-tls-certs\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.276568 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.275297    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fdc9\" (UniqueName: \"kubernetes.io/projected/776dbac9-7c0a-47b2-a2b4-eaf723467109-kube-api-access-2fdc9\") pod \"distinct-2-w0-df7236-kserve-5645f8f86d-xrhts\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") " pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.285221 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.285049    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:28.336225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.336186    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:28.438653 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:08:28.438438    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:08:28.668003 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:28.667980    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"]
Nov 03 06:08:28.669216 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:08:28.669187    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod776dbac9_7c0a_47b2_a2b4_eaf723467109.slice/crio-1d1ee664380810c5673500c2b86d14ce6aadec64a73bc8e2dca6181329c8da7b WatchSource:0}: Error finding container 1d1ee664380810c5673500c2b86d14ce6aadec64a73bc8e2dca6181329c8da7b: Status 404 returned error can't find the container with id 1d1ee664380810c5673500c2b86d14ce6aadec64a73bc8e2dca6181329c8da7b
Nov 03 06:08:29.383135 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:29.383095    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" event={"ID":"776dbac9-7c0a-47b2-a2b4-eaf723467109","Type":"ContainerStarted","Data":"28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5"}
Nov 03 06:08:29.383563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:29.383147    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" event={"ID":"776dbac9-7c0a-47b2-a2b4-eaf723467109","Type":"ContainerStarted","Data":"1d1ee664380810c5673500c2b86d14ce6aadec64a73bc8e2dca6181329c8da7b"}
Nov 03 06:08:29.427336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:29.427274    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podStartSLOduration=2.427259229 podStartE2EDuration="2.427259229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:08:29.424115665 +0000 UTC m=+796.794065749" watchObservedRunningTime="2026-11-03 06:08:29.427259229 +0000 UTC m=+796.797209312"
Nov 03 06:08:30.225848 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:30.225813    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:30.337171 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:30.337129    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:31.929182 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:31.929151    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:33.827579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:33.827541    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:35.417885 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:35.417848    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:37.020245 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:37.020204    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:38.336379 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.336347    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:38.349651 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.349625    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:38.446739 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.446703    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:38.755441 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.755399    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:38.789126 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.789083    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"]
Nov 03 06:08:38.793161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.793139    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.817433 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.817405    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"]
Nov 03 06:08:38.878960 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.878918    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879141 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.878972    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879141 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.879114    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f4e51f-a45e-4546-b6b2-a760615f2da2-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.879154    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.879247    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879293 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.879265    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.879294    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.879316    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.879425 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.879383    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pmn\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-kube-api-access-h7pmn\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.980983 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.980948    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f4e51f-a45e-4546-b6b2-a760615f2da2-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.980994    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981053    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981072    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981108    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981166    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981465 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981189    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pmn\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-kube-api-access-h7pmn\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981465 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981283    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981465 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981319    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981649 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981548    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981656    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981701    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.981868 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.981828    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f4e51f-a45e-4546-b6b2-a760615f2da2-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.982049 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.982029    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.983671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.983650    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:38.983754 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:38.983709    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:39.005166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.005135    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:39.005303 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.005265    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pmn\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-kube-api-access-h7pmn\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:39.110988 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.110900    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:39.438552 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:08:39.437747    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f4e51f_a45e_4546_b6b2_a760615f2da2.slice/crio-a4147e6c9243fffc21635bc4057dea7db31e3670c424af03a6e3f30c6b651b19 WatchSource:0}: Error finding container a4147e6c9243fffc21635bc4057dea7db31e3670c424af03a6e3f30c6b651b19: Status 404 returned error can't find the container with id a4147e6c9243fffc21635bc4057dea7db31e3670c424af03a6e3f30c6b651b19
Nov 03 06:08:39.442090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.442049    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:39.442208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.442142    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:39.442208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.442189    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:39.444756 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.444733    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"]
Nov 03 06:08:39.523933 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.523901    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"]
Nov 03 06:08:39.528334 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.528307    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.560010 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.559975    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"]
Nov 03 06:08:39.566541 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.561884    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:39.586962 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.586928    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.587277 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.587260    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.587936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.587916    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.588135 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.588118    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt6hp\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.588305 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.588292    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.588488 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.588472    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.588677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.588664    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.588801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.588789    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29019981-1664-4c52-bc0a-784c8061b931-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.588992 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.588946    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.707932 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.707833    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.708676 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.708493    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.709075 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.709057    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.710350 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.709557    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29019981-1664-4c52-bc0a-784c8061b931-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.710582 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.710562    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.711275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.710306    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29019981-1664-4c52-bc0a-784c8061b931-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.711534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.709463    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.711709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.711689    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.712469 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.712449    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.717562 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.717537    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.717737 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.717720    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6hp\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.717936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.717912    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.718437 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.718415    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.718624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.716100    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.719009 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.718986    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.719759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.719712    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.735284 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.735250    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.744697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.744671    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt6hp\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:39.844008 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:39.843972    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:40.168453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.168426    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"]
Nov 03 06:08:40.169886 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:08:40.169857    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29019981_1664_4c52_bc0a_784c8061b931.slice/crio-de2df0d98290ec015b8cc2b1e7f4b030169797093cafbfe958e39540e39af7b6 WatchSource:0}: Error finding container de2df0d98290ec015b8cc2b1e7f4b030169797093cafbfe958e39540e39af7b6: Status 404 returned error can't find the container with id de2df0d98290ec015b8cc2b1e7f4b030169797093cafbfe958e39540e39af7b6
Nov 03 06:08:40.172389 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.172355    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:40.172494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.172432    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:40.172494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.172473    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:40.454208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.454073    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:40.455937 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.455111    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" event={"ID":"37f4e51f-a45e-4546-b6b2-a760615f2da2","Type":"ContainerStarted","Data":"ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2"}
Nov 03 06:08:40.455937 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.455184    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" event={"ID":"37f4e51f-a45e-4546-b6b2-a760615f2da2","Type":"ContainerStarted","Data":"a4147e6c9243fffc21635bc4057dea7db31e3670c424af03a6e3f30c6b651b19"}
Nov 03 06:08:40.457536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.457473    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" event={"ID":"29019981-1664-4c52-bc0a-784c8061b931","Type":"ContainerStarted","Data":"abaa9fd41a1ec075c2280021bbb40a01e0ead950c98763cad7d87aeb2a2123ee"}
Nov 03 06:08:40.457669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.457571    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" event={"ID":"29019981-1664-4c52-bc0a-784c8061b931","Type":"ContainerStarted","Data":"de2df0d98290ec015b8cc2b1e7f4b030169797093cafbfe958e39540e39af7b6"}
Nov 03 06:08:40.517245 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.517179    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podStartSLOduration=2.517157188 podStartE2EDuration="2.517157188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:08:40.508430661 +0000 UTC m=+807.878380747" watchObservedRunningTime="2026-11-03 06:08:40.517157188 +0000 UTC m=+807.887107273"
Nov 03 06:08:40.555147 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.555082    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podStartSLOduration=1.555047651 podStartE2EDuration="1.555047651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:08:40.552743462 +0000 UTC m=+807.922693548" watchObservedRunningTime="2026-11-03 06:08:40.555047651 +0000 UTC m=+807.924997736"
Nov 03 06:08:40.783597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.773963    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"]
Nov 03 06:08:40.816137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.816097    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:40.822493 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.821825    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"]
Nov 03 06:08:40.831423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.831398    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-86728b\"/\"distinct-2-w6-86728b-kserve-self-signed-certs\""
Nov 03 06:08:40.844740 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.844706    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:40.902987 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.897289    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:40.940317 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.940285    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-dshm\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:40.940537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.940339    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed72d1de-7983-4050-9374-6bcb80b898a6-tls-certs\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:40.940537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.940379    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p69rs\" (UniqueName: \"kubernetes.io/projected/ed72d1de-7983-4050-9374-6bcb80b898a6-kube-api-access-p69rs\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:40.940682 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.940598    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-home\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:40.940739 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.940715    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-model-cache\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:40.940779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:40.940757    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-tmp-dir\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.043663    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-home\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.043769    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-model-cache\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.043805    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-tmp-dir\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.043923    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-dshm\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.043977    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed72d1de-7983-4050-9374-6bcb80b898a6-tls-certs\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.044052    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p69rs\" (UniqueName: \"kubernetes.io/projected/ed72d1de-7983-4050-9374-6bcb80b898a6-kube-api-access-p69rs\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.044974    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-home\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.045572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.045248    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-model-cache\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.046115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.045783    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-tmp-dir\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.058579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.056475    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed72d1de-7983-4050-9374-6bcb80b898a6-tls-certs\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.058579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.058428    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-dshm\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.089525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.088532    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p69rs\" (UniqueName: \"kubernetes.io/projected/ed72d1de-7983-4050-9374-6bcb80b898a6-kube-api-access-p69rs\") pod \"distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") " pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.116728 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.116692    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:41.117111 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.117090    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 03 06:08:41.117263 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.117239    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 03 06:08:41.146758 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.146717    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:41.669667 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.669640    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"]
Nov 03 06:08:41.671402 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:08:41.671374    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded72d1de_7983_4050_9374_6bcb80b898a6.slice/crio-caca7d1960d2b5bc2bb136fe819a9ff00f555758ad4e4126d94baf7d953ee509 WatchSource:0}: Error finding container caca7d1960d2b5bc2bb136fe819a9ff00f555758ad4e4126d94baf7d953ee509: Status 404 returned error can't find the container with id caca7d1960d2b5bc2bb136fe819a9ff00f555758ad4e4126d94baf7d953ee509
Nov 03 06:08:41.849772 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.846125    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 03 06:08:41.849772 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:41.846201    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 03 06:08:42.117697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:42.117658    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 03 06:08:42.117988 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:42.117959    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 03 06:08:42.438586 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:42.437303    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:42.532360 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:42.532329    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" event={"ID":"ed72d1de-7983-4050-9374-6bcb80b898a6","Type":"ContainerStarted","Data":"3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa"}
Nov 03 06:08:42.532614 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:42.532377    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" event={"ID":"ed72d1de-7983-4050-9374-6bcb80b898a6","Type":"ContainerStarted","Data":"caca7d1960d2b5bc2bb136fe819a9ff00f555758ad4e4126d94baf7d953ee509"}
Nov 03 06:08:42.845003 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:42.844926    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 03 06:08:42.845003 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:42.844975    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 03 06:08:43.122524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:43.119000    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 03 06:08:43.122524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:43.119059    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 03 06:08:43.147439 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:43.147410    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:43.844352 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:43.844317    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 03 06:08:43.844565 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:43.844372    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 03 06:08:44.116583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:44.112993    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 03 06:08:44.116583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:44.113054    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 03 06:08:44.317523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:44.309416    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:44.846526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:44.845971    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 03 06:08:44.846526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:44.846033    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 03 06:08:45.121613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:45.113935    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 03 06:08:45.121613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:45.113990    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 03 06:08:45.845635 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:45.845599    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 03 06:08:45.850724 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:45.850689    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 03 06:08:46.113162 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.113064    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 03 06:08:46.113475 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.113442    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 03 06:08:46.312526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.299648    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:08:46.352530 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.351653    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:08:46.456523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.455578    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:08:46.568523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.562383    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:08:46.659526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.651407    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Nov 03 06:08:46.773580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.773276    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:08:46.854526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.846941    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 03 06:08:46.854526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.847010    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 03 06:08:46.923338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.923291    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:46.948946 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:46.948906    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:08:47.137898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.137865    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 03 06:08:47.145641 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.145603    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 03 06:08:47.415732 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.415640    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:08:47.417442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.417421    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:47.462534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.457810    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:08:47.462534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.459140    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:47.485288 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.485229    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podStartSLOduration=7.4852073820000005 podStartE2EDuration="7.485207382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:08:42.59554017 +0000 UTC m=+809.965490258" watchObservedRunningTime="2026-11-03 06:08:47.485207382 +0000 UTC m=+814.855157471"
Nov 03 06:08:47.517114 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.517050    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:08:47.518923 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.518895    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:08:47.855575 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.850741    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 03 06:08:47.855575 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:47.850793    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 03 06:08:48.516580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:48.516470    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:48.519132 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:48.519111    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:48.528763 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:48.528741    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:08:49.250524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:49.247184    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:49.412289 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:49.411659    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:49.416166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:49.412890    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:49.420378 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:49.420327    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:08:51.127104 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:51.127067    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:51.147155 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:51.147128    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:51.163563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:51.163534    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:51.747437 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:51.747405    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:08:52.846245 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:52.846212    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:54.554872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.554791    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"]
Nov 03 06:08:54.561785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.561747    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.580534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.580469    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"]
Nov 03 06:08:54.628580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.628547    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:54.682819 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.682780    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptxw4\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-kube-api-access-ptxw4\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.682986 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.682848    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.682986 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.682968    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.683069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.683005    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.683069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.683035    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66151bde-baff-4252-849b-9a70cdcb4aec-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.683213 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.683192    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.683286 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.683267    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.683361 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.683344    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.683428 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.683413    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66151bde-baff-4252-849b-9a70cdcb4aec-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784291    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptxw4\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-kube-api-access-ptxw4\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784348    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784396    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784431    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784454    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66151bde-baff-4252-849b-9a70cdcb4aec-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784550    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784613    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784666    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784851 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784750    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66151bde-baff-4252-849b-9a70cdcb4aec-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.784851 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.784763    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-data\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.785092 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.785070    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-credential-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.785163 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.785141    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-socket\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.785256 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.785233    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-certs\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.785490 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.785461    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66151bde-baff-4252-849b-9a70cdcb4aec-istiod-ca-cert\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.786806 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.786777    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-envoy\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.787245 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.787219    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66151bde-baff-4252-849b-9a70cdcb4aec-istio-podinfo\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.807137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.807085    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-istio-token\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.807224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.807166    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptxw4\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-kube-api-access-ptxw4\") pod \"e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") " pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:54.882101 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:54.882073    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:55.200558 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.200534    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"]
Nov 03 06:08:55.201496 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:08:55.201462    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66151bde_baff_4252_849b_9a70cdcb4aec.slice/crio-0b79560fd7ad2eb2a0c80b1517246b7397aa4a2deef993b6959a077405aa6ff5 WatchSource:0}: Error finding container 0b79560fd7ad2eb2a0c80b1517246b7397aa4a2deef993b6959a077405aa6ff5: Status 404 returned error can't find the container with id 0b79560fd7ad2eb2a0c80b1517246b7397aa4a2deef993b6959a077405aa6ff5
Nov 03 06:08:55.203883 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.203846    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:55.203992 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.203923    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:55.204050 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.203967    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:08:55.762398 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.762368    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" event={"ID":"66151bde-baff-4252-849b-9a70cdcb4aec","Type":"ContainerStarted","Data":"17098fc956ce01c689799e4cfba63a8934d66d02c352c138f1ce87693f3db301"}
Nov 03 06:08:55.762876 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.762422    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" event={"ID":"66151bde-baff-4252-849b-9a70cdcb4aec","Type":"ContainerStarted","Data":"0b79560fd7ad2eb2a0c80b1517246b7397aa4a2deef993b6959a077405aa6ff5"}
Nov 03 06:08:55.848805 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.848758    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podStartSLOduration=1.848744306 podStartE2EDuration="1.848744306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:08:55.836183138 +0000 UTC m=+823.206133222" watchObservedRunningTime="2026-11-03 06:08:55.848744306 +0000 UTC m=+823.218694391"
Nov 03 06:08:55.898526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:55.898388    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:08:56.396524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:56.394126    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:56.893908 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:56.893598    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 06:08:56.893908 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:56.893659    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 06:08:57.891946 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:57.891911    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 06:08:57.892228 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:57.892199    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 06:08:58.164223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:58.164133    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:08:58.422567 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:08:58.422461    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:08:58.885915 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:58.885880    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 06:08:58.886194 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:58.886166    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 06:08:59.883523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:59.882833    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 06:08:59.883523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:08:59.882902    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 06:09:00.053041 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:00.053009    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:00.890525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:00.885858    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 06:09:00.890525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:00.885919    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 06:09:01.841328 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:01.841292    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:01.883284 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:01.883242    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 06:09:01.883517 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:01.883322    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 06:09:02.886964 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:02.886938    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:09:02.887365 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:02.887341    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:09:02.887901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:02.887883    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:09:03.203246 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.203164    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"]
Nov 03 06:09:03.207417 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.207393    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.221918 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.221899    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 03 06:09:03.222028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.221969    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 03 06:09:03.222028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.221969    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 03 06:09:03.222118 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.222033    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mrr85\""
Nov 03 06:09:03.230346 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.230323    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"]
Nov 03 06:09:03.330632 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.330604    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.330795 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.330777    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.330839 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.330827    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.330917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.330899    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.330958 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.330935    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf7nz\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-kube-api-access-gf7nz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.331015 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.330998    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.331086 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.331066    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f86e1-33c5-4182-abda-5283257591b6-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.432301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.432269    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.432599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.432323    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.432599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.432435    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.432599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.432483    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf7nz\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-kube-api-access-gf7nz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.432599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.432546    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.432599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.432599    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f86e1-33c5-4182-abda-5283257591b6-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.433021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.432824    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.433385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.433352    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.435046 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.435025    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f86e1-33c5-4182-abda-5283257591b6-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.435163 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.435069    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.435163 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.435097    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.435280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.435202    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.455236 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.455184    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf7nz\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-kube-api-access-gf7nz\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.455477 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.455461    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-ltgsc\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.520567 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.520523    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:03.552071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.552032    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:03.849674 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:03.849646    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"]
Nov 03 06:09:03.850443 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:09:03.850419    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3f86e1_33c5_4182_abda_5283257591b6.slice/crio-d18fe875b5a63ef8ac3b85e690770f86a294b1751312d74e8d141e49a9806a6d WatchSource:0}: Error finding container d18fe875b5a63ef8ac3b85e690770f86a294b1751312d74e8d141e49a9806a6d: Status 404 returned error can't find the container with id d18fe875b5a63ef8ac3b85e690770f86a294b1751312d74e8d141e49a9806a6d
Nov 03 06:09:04.761188 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:04.761156    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:04.839624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:04.839585    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" event={"ID":"df3f86e1-33c5-4182-abda-5283257591b6","Type":"ContainerStarted","Data":"d18fe875b5a63ef8ac3b85e690770f86a294b1751312d74e8d141e49a9806a6d"}
Nov 03 06:09:05.247085 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:05.247049    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:07.166557 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:07.166406    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:07.329709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:07.323475    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:07.329709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:07.323605    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:07.965528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:07.952819    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" event={"ID":"df3f86e1-33c5-4182-abda-5283257591b6","Type":"ContainerStarted","Data":"c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e"}
Nov 03 06:09:07.965528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:07.953962    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:08.067560 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.056845    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" podStartSLOduration=1.589393515 podStartE2EDuration="5.056825724s" totalImagesPullingTime="3.467432209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:09:08.034112433 +0000 UTC m=+835.404062541" watchObservedRunningTime="2026-11-03 06:09:08.056825724 +0000 UTC m=+835.426775813"
Nov 03 06:09:08.520526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.520378    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:09:08.565699 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.565602    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:08.646698 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.645619    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:08.739761 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.739707    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:08.785582 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.782187    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:08.785582 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.782657    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/health\": context deadline exceeded"
Nov 03 06:09:08.830687 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.830647    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:08.923021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:08.922977    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:09.026522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.013723    4418 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-ltgsc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:09:09.026522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.013783    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" podUID="df3f86e1-33c5-4182-abda-5283257591b6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:09:09.031068 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.031032    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"]
Nov 03 06:09:09.037822 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.037751    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.074598 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.068046    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"]
Nov 03 06:09:09.196105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196068    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196357    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196487    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196560    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196588    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7353a86e-334f-40f0-ab22-a1c837591d17-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196697    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196741    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cblk5\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-kube-api-access-cblk5\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196784    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.196847    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7353a86e-334f-40f0-ab22-a1c837591d17-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.197766 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.197750    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"]
Nov 03 06:09:09.207522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.202977    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.305413 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.305303    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.306209 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.306064    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.306425 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.306392    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.315543 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.306641    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.317058 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.317031    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.317297 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.317281    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.328948 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.328915    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.329202 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.329185    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.329322 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.329308    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7353a86e-334f-40f0-ab22-a1c837591d17-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.329490 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.329466    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgw4\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-kube-api-access-qdgw4\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.329691 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.329675    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.329818 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.329802    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.329963 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.329948    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cblk5\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-kube-api-access-cblk5\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.330102 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.330087    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f243914-6e3e-419d-a81a-4330e1f24ae8-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.330244 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.330228    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.330419 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.330405    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.354550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.354526    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7353a86e-334f-40f0-ab22-a1c837591d17-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.354922 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.354883    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.355229 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.355203    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.403739 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.328841    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.404033 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.354388    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7353a86e-334f-40f0-ab22-a1c837591d17-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.404171 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.341308    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:09.404677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.341262    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:09.404880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.341671    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.405019 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.380623    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"]
Nov 03 06:09:09.405194 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.389897    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.550526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.490539    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.595932    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.598303    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.598676    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.620673    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642438    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgw4\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-kube-api-access-qdgw4\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642552    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642618    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f243914-6e3e-419d-a81a-4330e1f24ae8-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642684    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642714    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642788    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642866    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642894    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.642956    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.643482    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.651439    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f243914-6e3e-419d-a81a-4330e1f24ae8-istiod-ca-cert\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.651694    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-data\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.651908    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-credential-socket\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.743787    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-certs\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.743871    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.743972    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.745280    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cblk5\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-kube-api-access-cblk5\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.802603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.747695    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-token\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.843355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.841076    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:09.843355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.842132    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:09:09.939536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.931917    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.940158 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.935034    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7353a86e-334f-40f0-ab22-a1c837591d17-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:09.945756 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.936087    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:09.948750 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.948725    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:09:09.968891 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.957368    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-podinfo\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.969474 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.969401    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-envoy\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:09.997226 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:09.997196    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:10.065676 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.023920    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgw4\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-kube-api-access-qdgw4\") pod \"e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") " pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:10.125528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.096089    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:09:10.158536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.141588    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"]
Nov 03 06:09:10.206540 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.202633    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:10.212702 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.212673    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.317780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.317693    4418 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-ltgsc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:09:10.317780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.317764    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" podUID="df3f86e1-33c5-4182-abda-5283257591b6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:09:10.364267 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364212    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364399 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364272    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqrc2\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-kube-api-access-tqrc2\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364399 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364350    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364585 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364410    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364585 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364440    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364585 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364482    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364584    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364622    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.364770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.364718    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486304    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486376    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486407    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486450    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486524    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486560    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486627    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486746    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.486779    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqrc2\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-kube-api-access-tqrc2\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.491533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.487616    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"]
Nov 03 06:09:10.544561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.509120    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.544561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.509415    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.544561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.509677    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.544561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.509902    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.544561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.510572    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.568182 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.547601    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:10.640199 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.637389    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"]
Nov 03 06:09:10.640812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.640479    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.763307 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.763281    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:09:10.790638 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.790594    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:10.843523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.840741    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.845152 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.845119    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqrc2\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-kube-api-access-tqrc2\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.915906 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.848451    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.915906 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.899110    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Nov 03 06:09:10.918727 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.918696    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.918955 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.918932    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.919130 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.919111    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.919455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.919435    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.919610 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.919592    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.919773 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.919756    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.920034 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.920016    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.927146 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.927124    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"]
Nov 03 06:09:10.930529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.920185    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x48sr\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-kube-api-access-x48sr\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:10.930896 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.927332    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.931062 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.929828    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:10.993539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:10.982979    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:09:11.014045 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.014014    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035239    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035301    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x48sr\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-kube-api-access-x48sr\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035410    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035454    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035483    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035547    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035650    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035675    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.035717    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.036521    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istiod-ca-cert\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.037349    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-credential-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.038145    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-socket\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.038553    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-data\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.051340    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-podinfo\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.054536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.052885    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-certs\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.060944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.060910    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-envoy\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.064308 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.064284    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:11.103742 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.100208    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x48sr\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-kube-api-access-x48sr\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.106194 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.106164    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"]
Nov 03 06:09:11.108564 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.108346    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-token\") pod \"e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") " pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.118114 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.118085    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"]
Nov 03 06:09:11.128038 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:09:11.127580    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7353a86e_334f_40f0_ab22_a1c837591d17.slice/crio-167353ee11aa7e1487e8a232d5aa2dc9b18984c6f56b02025d8a4f6823b2000a WatchSource:0}: Error finding container 167353ee11aa7e1487e8a232d5aa2dc9b18984c6f56b02025d8a4f6823b2000a: Status 404 returned error can't find the container with id 167353ee11aa7e1487e8a232d5aa2dc9b18984c6f56b02025d8a4f6823b2000a
Nov 03 06:09:11.129131 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.129095    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.129232 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.129180    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.129232 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.129226    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.130429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.130401    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.130637 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.130610    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.130734 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.130660    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.178162 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.178092    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:11.391947 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.390784    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" event={"ID":"7353a86e-334f-40f0-ab22-a1c837591d17","Type":"ContainerStarted","Data":"022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1"}
Nov 03 06:09:11.391947 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.390851    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" event={"ID":"7353a86e-334f-40f0-ab22-a1c837591d17","Type":"ContainerStarted","Data":"167353ee11aa7e1487e8a232d5aa2dc9b18984c6f56b02025d8a4f6823b2000a"}
Nov 03 06:09:11.414525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.412683    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" event={"ID":"5f243914-6e3e-419d-a81a-4330e1f24ae8","Type":"ContainerStarted","Data":"6e9114cdc6aa90df6386875d069ee0987d79b57362676403e82059ba0f1ed519"}
Nov 03 06:09:11.414525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.412756    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" event={"ID":"5f243914-6e3e-419d-a81a-4330e1f24ae8","Type":"ContainerStarted","Data":"d73acaea2bfa8c14edc188f37f86e9de3269f1ace09d6e3af6a7e357bb7c1a0d"}
Nov 03 06:09:11.448965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.448561    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podStartSLOduration=3.448539036 podStartE2EDuration="3.448539036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:09:11.446413101 +0000 UTC m=+838.816363186" watchObservedRunningTime="2026-11-03 06:09:11.448539036 +0000 UTC m=+838.818489116"
Nov 03 06:09:11.499646 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.499580    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podStartSLOduration=2.499557125 podStartE2EDuration="2.499557125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:09:11.490238955 +0000 UTC m=+838.860189040" watchObservedRunningTime="2026-11-03 06:09:11.499557125 +0000 UTC m=+838.869507230"
Nov 03 06:09:11.517534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.517306    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.517534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.517399    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.517534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.517441    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.552103 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.538258    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"]
Nov 03 06:09:11.577630 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.577585    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"]
Nov 03 06:09:11.608869 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.608809    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.608979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.608906    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:11.608979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:11.608952    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:12.008203 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.008071    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:12.009553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.009529    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:12.009695 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.009590    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:12.209076 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.209043    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:12.262608 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.254802    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:12.263249 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.262857    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:12.263249 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.262916    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:12.444450 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.444410    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" event={"ID":"8dad292a-0c05-4c75-bd7b-3b230ea29bfb","Type":"ContainerStarted","Data":"89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152"}
Nov 03 06:09:12.444716 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.444695    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" event={"ID":"8dad292a-0c05-4c75-bd7b-3b230ea29bfb","Type":"ContainerStarted","Data":"01a2f5973fb5d7f72394f80295346dc2fc44ab5f229ffb7c19e0c4e0a58c46de"}
Nov 03 06:09:12.454791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.454735    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" event={"ID":"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2","Type":"ContainerStarted","Data":"b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54"}
Nov 03 06:09:12.454949 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.454821    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" event={"ID":"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2","Type":"ContainerStarted","Data":"0c7500f8df4fc37416ca175e5c001185cbd004844d693618c419ec01c1d0f139"}
Nov 03 06:09:12.522433 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.522335    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:12.560637 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.555116    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podStartSLOduration=3.555097412 podStartE2EDuration="3.555097412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:09:12.498880612 +0000 UTC m=+839.868830708" watchObservedRunningTime="2026-11-03 06:09:12.555097412 +0000 UTC m=+839.925047497"
Nov 03 06:09:13.007524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.999415    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:13.007524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:12.999474    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:13.228597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.217944    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:13.228597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.218003    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:13.228597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.220088    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:13.228597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.220196    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:13.228597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.220230    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:13.256527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.231532    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:13.256944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.242338    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:13.257254 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.257215    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:13.308867 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.308773    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:09:13.465527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.419425    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podStartSLOduration=4.419398388 podStartE2EDuration="4.419398388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:09:12.562898304 +0000 UTC m=+839.932848388" watchObservedRunningTime="2026-11-03 06:09:13.419398388 +0000 UTC m=+840.789348473"
Nov 03 06:09:13.739804 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.739752    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Nov 03 06:09:13.805167 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.746668    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:13.979683 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.932733    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:13.988878 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:13.971050    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:14.018464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.018359    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:14.047935 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.047901    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:14.057749 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.057658    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:14.104120 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.104071    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:14.107530 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.104391    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:14.181399 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.181357    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:14.181720 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.181675    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:14.221869 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.221822    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:14.222250 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.222184    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:14.232807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.232762    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:14.579527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.578435    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:14.774427 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.774379    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:14.779543 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.775448    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:09:14.897581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.832654    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:14.980198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.980157    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:14.995441 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.995290    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:09:14.997433 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:14.997225    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Nov 03 06:09:15.058673 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.058635    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:09:15.059254 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.059235    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:09:15.059452 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.059437    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:09:15.075242 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.075208    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:15.075491 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.075462    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:15.095288 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.095255    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:15.097722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.097689    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:15.129966 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.129921    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:15.130804 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.130775    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:15.189600 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.189513    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:15.190980 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.190947    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:15.213313 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.213279    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:15.213592 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.213557    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:15.238737 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.238698    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:09:15.250529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.239333    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:09:15.306461 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.306401    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": context deadline exceeded"
Nov 03 06:09:15.589969 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.589869    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:15.643524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.604273    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:09:15.777701 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.775185    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:16.000523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.996788    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:09:16.012526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.004883    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:16.054550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.998843    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:09:16.054550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:15.998794    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:16.054550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.016902    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:09:16.099650 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.099604    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:16.161799 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.100018    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:16.161799 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.161704    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:16.161799 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.136472    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:16.161799 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.161762    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:16.244227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.222543    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:16.244227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.222604    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:16.244227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.222860    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:16.244227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.222888    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:16.244227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.239713    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:09:16.344579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.340841    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:16.344579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.341231    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:09:16.550528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.533770    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Nov 03 06:09:16.552794 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.552470    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:09:16.607202 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.606764    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:16.791529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.789091    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:16.958527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:16.958275    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.045528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.045325    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:17.045528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.045383    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:17.060782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.047724    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.060782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.048816    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.060782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.049810    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.060782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.052312    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:09:17.121525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.118352    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:17.121525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.118426    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:17.174271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.173068    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.195040 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.194533    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:17.195040 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.194594    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:17.249581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.246300    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:17.249581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.246371    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:17.249581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.246468    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.544581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.538817    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.555331 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.555281    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.625098 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.625068    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:09:17.633527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.632024    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:09:17.633527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.632148    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:09:17.633527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.632210    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:09:17.836604 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.815731    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:17.998522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:17.998469    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:18.056527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.023681    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Nov 03 06:09:18.126526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.026457    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:18.126526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.124704    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:18.126526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.058113    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Nov 03 06:09:18.126526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.058078    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:09:18.168521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.098010    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:18.168521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.134540    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:18.168521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.058148    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:09:18.218659 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.218608    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:18.265597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.258269    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:18.265930 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.265881    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:18.324741 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.324706    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:18.325050 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.325021    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:18.512587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.477982    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:18.554784 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.553532    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:18.594527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.556815    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:18.594527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.584162    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:09:18.668251 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.668219    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:09:18.926843 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:18.926812    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:09:19.018525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.016873    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:19.018525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.016930    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:19.059971 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.059541    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:19.079656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.079625    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:19.088643 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.088604    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:19.099603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.099565    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Nov 03 06:09:19.193577 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.192569    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:09:19.217538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.196790    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:19.217538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.196849    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:19.217538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.162673    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:19.217538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.211044    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:19.234534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.233027    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:19.234534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.233080    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:19.240809 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.240783    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:09:19.279036 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.279002    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:09:19.670088 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.670035    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:09:19.671769 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.671739    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:19.720635 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.720592    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/health\": context deadline exceeded"
Nov 03 06:09:19.744329 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.744301    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:09:19.823295 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.823269    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:09:19.871799 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.871769    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:09:19.924791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.924059    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:09:19.998664 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.998627    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 03 06:09:19.998823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:19.998699    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 03 06:09:20.072363 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:20.070788    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 06:09:20.072363 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:20.070857    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 06:09:20.179280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:20.179188    4418 patch_prober.go:29] interesting pod/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Nov 03 06:09:20.179590 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:20.179551    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Nov 03 06:09:20.233571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:20.232121    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 06:09:20.233571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:20.232756    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 06:09:20.342964 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:20.342928    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:21.350836 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.350805    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:21.352938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.352917    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:21.356217 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.356194    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:09:21.578698 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.578662    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:21.580568 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.580544    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:21.582602 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.582551    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:09:21.720708 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.720679    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:21.726751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.726727    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:21.728206 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.728190    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:09:21.808583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.808547    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:21.809224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.809138    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:21.810755 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:21.810733    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:09:22.638796 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:22.638762    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:23.908810 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:23.908776    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"]
Nov 03 06:09:23.917419 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:23.917396    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:23.937174 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:23.937147    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"]
Nov 03 06:09:24.001886 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.001850    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002048 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.001946    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002130 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.002106    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002241 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.002220    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5m2z\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-kube-api-access-l5m2z\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002328 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.002264    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002328 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.002319    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.002347    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c671e07-7934-4c48-87d8-06979fa291eb-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.002488    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c671e07-7934-4c48-87d8-06979fa291eb-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.002606 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.002577    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.083376 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.083339    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:24.104157 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104123    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5m2z\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-kube-api-access-l5m2z\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104157 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104160    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104187    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104210    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c671e07-7934-4c48-87d8-06979fa291eb-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104243    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c671e07-7934-4c48-87d8-06979fa291eb-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104310    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104383    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104452    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104593    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104642    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-credential-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104695    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-certs\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.104909 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.104830    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-socket\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.105095 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.105070    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-data\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.105178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.105089    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c671e07-7934-4c48-87d8-06979fa291eb-istiod-ca-cert\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.106981 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.106955    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-envoy\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.107089 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.107013    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c671e07-7934-4c48-87d8-06979fa291eb-istio-podinfo\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.127480 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.127448    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-istio-token\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.127696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.127679    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5m2z\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-kube-api-access-l5m2z\") pod \"e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") " pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.265890 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.265802    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:24.388150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.379188    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:24.594063 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.594025    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"]
Nov 03 06:09:24.595469 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:09:24.595440    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c671e07_7934_4c48_87d8_06979fa291eb.slice/crio-1cb8ac23c02de876a89fb858dd78eec9b55b452d7fae1e97a518d5a7e3d90b8a WatchSource:0}: Error finding container 1cb8ac23c02de876a89fb858dd78eec9b55b452d7fae1e97a518d5a7e3d90b8a: Status 404 returned error can't find the container with id 1cb8ac23c02de876a89fb858dd78eec9b55b452d7fae1e97a518d5a7e3d90b8a
Nov 03 06:09:24.599512 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.599441    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:24.599658 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.599634    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:24.599750 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.599730    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:24.613969 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.613937    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"]
Nov 03 06:09:24.621334 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.621289    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.636624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.636592    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"]
Nov 03 06:09:24.715194 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715159    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715460 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715430    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnj6x\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-kube-api-access-rnj6x\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715557    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715729 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715596    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715729 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715620    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573ba103-e498-42ed-bbf5-26cb9a559f87-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715846 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715802    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715905 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715865    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715951 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715916    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.715990 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.715947    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.817745 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.817708    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.817938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.817912    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnj6x\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-kube-api-access-rnj6x\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.817956    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.817992    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818020    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573ba103-e498-42ed-bbf5-26cb9a559f87-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818062    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818158    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818218    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818264    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818304    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818350    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.818801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818615    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.819241 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.818858    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.822014 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.821985    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.822168 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.822145    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573ba103-e498-42ed-bbf5-26cb9a559f87-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.822233 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.822203    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.842978 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.842893    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.843119 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.843056    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnj6x\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-kube-api-access-rnj6x\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:24.903999 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.900446    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" event={"ID":"9c671e07-7934-4c48-87d8-06979fa291eb","Type":"ContainerStarted","Data":"28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521"}
Nov 03 06:09:24.903999 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.900575    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" event={"ID":"9c671e07-7934-4c48-87d8-06979fa291eb","Type":"ContainerStarted","Data":"1cb8ac23c02de876a89fb858dd78eec9b55b452d7fae1e97a518d5a7e3d90b8a"}
Nov 03 06:09:24.947962 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.947910    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podStartSLOduration=1.947894623 podStartE2EDuration="1.947894623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:09:24.943750659 +0000 UTC m=+852.313700766" watchObservedRunningTime="2026-11-03 06:09:24.947894623 +0000 UTC m=+852.317844764"
Nov 03 06:09:24.959037 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:24.959005    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:25.266303 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.266253    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:25.267748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.267720    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Nov 03 06:09:25.267823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.267767    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Nov 03 06:09:25.300117 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:09:25.300085    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573ba103_e498_42ed_bbf5_26cb9a559f87.slice/crio-35ca49e2b3d429371d846c31e721b014a37a1536490cde2759b2d291f3062ec1 WatchSource:0}: Error finding container 35ca49e2b3d429371d846c31e721b014a37a1536490cde2759b2d291f3062ec1: Status 404 returned error can't find the container with id 35ca49e2b3d429371d846c31e721b014a37a1536490cde2759b2d291f3062ec1
Nov 03 06:09:25.311113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.311071    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"]
Nov 03 06:09:25.315006 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.314965    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:25.316828 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.315295    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:25.317125 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.317094    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:09:25.908861 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.908824    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" event={"ID":"573ba103-e498-42ed-bbf5-26cb9a559f87","Type":"ContainerStarted","Data":"909407a53e0b60468a887651edcebf2b7cd222b84c2986662da45e0c95fea2b5"}
Nov 03 06:09:25.909071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.908892    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" event={"ID":"573ba103-e498-42ed-bbf5-26cb9a559f87","Type":"ContainerStarted","Data":"35ca49e2b3d429371d846c31e721b014a37a1536490cde2759b2d291f3062ec1"}
Nov 03 06:09:25.959406 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.959372    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:25.961661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:25.961613    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podStartSLOduration=1.9615974600000001 podStartE2EDuration="1.96159746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:09:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:09:25.957474103 +0000 UTC m=+853.327424218" watchObservedRunningTime="2026-11-03 06:09:25.96159746 +0000 UTC m=+853.331547545"
Nov 03 06:09:26.266947 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:26.266850    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Nov 03 06:09:26.267275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:26.267244    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Nov 03 06:09:26.522579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:26.512961    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:26.960479 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:26.960446    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Nov 03 06:09:26.961058 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:26.960509    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Nov 03 06:09:27.266356 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:27.266275    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Nov 03 06:09:27.266356 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:27.266331    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Nov 03 06:09:27.959925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:27.959898    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Nov 03 06:09:27.960150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:27.960124    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Nov 03 06:09:28.266723 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:28.266644    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Nov 03 06:09:28.266723 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:28.266697    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Nov 03 06:09:28.446804 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:09:28.446766    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:09:28.834250 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:28.834216    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:28.959761 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:28.959726    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Nov 03 06:09:28.959969 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:28.959773    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Nov 03 06:09:29.017523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:29.006005    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:29.266151 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:29.266115    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Nov 03 06:09:29.266323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:29.266178    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Nov 03 06:09:29.960150 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:29.960107    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Nov 03 06:09:29.960612 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:29.960178    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Nov 03 06:09:30.266671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:30.266586    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Nov 03 06:09:30.266671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:30.266646    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Nov 03 06:09:30.959914 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:30.959882    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Nov 03 06:09:30.960097 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:30.959945    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Nov 03 06:09:31.069481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:31.068399    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:31.266320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:31.266231    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Nov 03 06:09:31.266320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:31.266293    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Nov 03 06:09:31.959915 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:31.959870    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Nov 03 06:09:31.960129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:31.959955    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Nov 03 06:09:32.270463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:32.270377    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:32.270898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:32.270795    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:32.271437 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:32.271419    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:09:32.965914 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:32.965879    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:32.966810 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:32.966716    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:32.967648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:32.967610    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:09:33.044310 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:33.043536    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:34.742874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:34.742839    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:36.447396 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:36.447363    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:38.002180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:38.002147    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:40.239969 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:40.239938    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:42.803528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:42.792168    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:43.014535 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.013278    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"]
Nov 03 06:09:43.117590 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.083919    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:43.355541 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.355480    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:43.358145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.358112    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:09:43.375255 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.375169    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:43.618652 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.618606    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:43.656803 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.656648    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Nov 03 06:09:43.685677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:43.685632    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:44.175526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.173604    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:44.175526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.174028    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 06:09:44.175526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.174302    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:09:44.228318 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.227571    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:09:44.364550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.358626    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:44.364550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.359101    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:09:44.415845 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.415792    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:44.416947 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.416926    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:09:44.430091 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.429998    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:44.460370 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.460342    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:09:44.670209 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.670162    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:44.673209 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.673184    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:09:44.728199 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.728099    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:44.729189 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:44.729165    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:09:45.118524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.117970    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:09:45.202981 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.202935    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:45.237544 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.230428    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Nov 03 06:09:45.259916 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.259886    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:09:45.260237 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.260219    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:09:45.262396 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.262359    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:09:45.264452 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.264263    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:09:45.431320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.431190    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:09:45.433366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.433318    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:45.671865 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.671820    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:45.788579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:45.735688    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.210674 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.210624    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.236034 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.235990    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.321350 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.320624    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.434527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.434092    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.471580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.471082    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.610522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.609611    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.719017 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.718294    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.741862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.741180    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:46.779962 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:46.774537    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:09:47.077711 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.065596    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:47.129036 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.129007    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:09:47.136279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.136243    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:09:47.157198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.157171    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:09:47.168491 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.168467    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:09:47.172149 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.172108    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:09:47.245897 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.240566    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:09:47.609891 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.609834    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Nov 03 06:09:47.611726 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.611701    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:09:47.660112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.660082    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:09:47.685579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:47.685547    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:09:49.475404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:49.475366    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:49.757695 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:49.757608    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:49.936337 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:49.936290    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:51.442734 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:51.442704    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:53.314525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:53.314475    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:55.098898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.098864    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:55.499010 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.498966    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"]
Nov 03 06:09:55.504349 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.504328    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.522268 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.522244    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 06:09:55.523705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.523682    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"]
Nov 03 06:09:55.531234 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.531209    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rxh5n\""
Nov 03 06:09:55.624448 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.624401    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.624639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.624450    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v42k\" (UniqueName: \"kubernetes.io/projected/6d84786e-97c9-44b3-bbc7-bcb70c641534-kube-api-access-9v42k\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.624692 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.624645    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-xks-ca\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.725785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.725751    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.725785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.725790    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v42k\" (UniqueName: \"kubernetes.io/projected/6d84786e-97c9-44b3-bbc7-bcb70c641534-kube-api-access-9v42k\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.725999 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.725854    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-xks-ca\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.726682 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.726653    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.728191 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.728167    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-xks-ca\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.749553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.749476    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v42k\" (UniqueName: \"kubernetes.io/projected/6d84786e-97c9-44b3-bbc7-bcb70c641534-kube-api-access-9v42k\") pod \"maas-api-revoke-sub-276e0608-tmb89\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:55.818217 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:55.818184    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:56.118548 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:56.118522    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"]
Nov 03 06:09:56.119553 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:09:56.119528    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d84786e_97c9_44b3_bbc7_bcb70c641534.slice/crio-ed1362c0c076a7f01ffa76247748e1b7a7a5ecb91f6185fe22d785e1b0e5eff7 WatchSource:0}: Error finding container ed1362c0c076a7f01ffa76247748e1b7a7a5ecb91f6185fe22d785e1b0e5eff7: Status 404 returned error can't find the container with id ed1362c0c076a7f01ffa76247748e1b7a7a5ecb91f6185fe22d785e1b0e5eff7
Nov 03 06:09:57.042417 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:57.042383    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:57.098660 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:57.098371    4418 generic.go:356] "Generic (PLEG): container finished" podID="6d84786e-97c9-44b3-bbc7-bcb70c641534" containerID="a28b6babd7160ed5fb1ae47e6a9d6cf79a255d7aec23cf339fd275ed3b834f2f" exitCode=0
Nov 03 06:09:57.098660 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:57.098485    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89" event={"ID":"6d84786e-97c9-44b3-bbc7-bcb70c641534","Type":"ContainerDied","Data":"a28b6babd7160ed5fb1ae47e6a9d6cf79a255d7aec23cf339fd275ed3b834f2f"}
Nov 03 06:09:57.098660 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:57.098576    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89" event={"ID":"6d84786e-97c9-44b3-bbc7-bcb70c641534","Type":"ContainerStarted","Data":"ed1362c0c076a7f01ffa76247748e1b7a7a5ecb91f6185fe22d785e1b0e5eff7"}
Nov 03 06:09:58.273109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.273081    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:58.362788 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.362713    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-xks-ca\") pod \"6d84786e-97c9-44b3-bbc7-bcb70c641534\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") "
Nov 03 06:09:58.362999 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.362980    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d84786e-97c9-44b3-bbc7-bcb70c641534-kube-api-access-9v42k\" (UniqueName: \"kubernetes.io/projected/6d84786e-97c9-44b3-bbc7-bcb70c641534-kube-api-access-9v42k\") pod \"6d84786e-97c9-44b3-bbc7-bcb70c641534\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") "
Nov 03 06:09:58.363052 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.363019    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-openshift-ca\") pod \"6d84786e-97c9-44b3-bbc7-bcb70c641534\" (UID: \"6d84786e-97c9-44b3-bbc7-bcb70c641534\") "
Nov 03 06:09:58.363483 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.363450    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-openshift-ca" pod "6d84786e-97c9-44b3-bbc7-bcb70c641534" (UID: "6d84786e-97c9-44b3-bbc7-bcb70c641534"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:09:58.363731 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.363712    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-openshift-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:09:58.366246 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.366223    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-xks-ca" pod "6d84786e-97c9-44b3-bbc7-bcb70c641534" (UID: "6d84786e-97c9-44b3-bbc7-bcb70c641534"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:09:58.366355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.366241    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d84786e-97c9-44b3-bbc7-bcb70c641534-kube-api-access-9v42k" pod "6d84786e-97c9-44b3-bbc7-bcb70c641534" (UID: "6d84786e-97c9-44b3-bbc7-bcb70c641534"). InnerVolumeSpecName "kube-api-access-9v42k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:09:58.408536 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:09:58.408481    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:09:58.473327 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.465923    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v42k\" (UniqueName: \"kubernetes.io/projected/6d84786e-97c9-44b3-bbc7-bcb70c641534-kube-api-access-9v42k\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:09:58.473327 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.465960    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d84786e-97c9-44b3-bbc7-bcb70c641534-maas-api-xks-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:09:58.747896 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:58.747845    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:09:59.113338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:59.113255    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"
Nov 03 06:09:59.113338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:59.113289    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89" event={"ID":"6d84786e-97c9-44b3-bbc7-bcb70c641534","Type":"ContainerDied","Data":"ed1362c0c076a7f01ffa76247748e1b7a7a5ecb91f6185fe22d785e1b0e5eff7"}
Nov 03 06:09:59.113338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:09:59.113339    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed1362c0c076a7f01ffa76247748e1b7a7a5ecb91f6185fe22d785e1b0e5eff7"
Nov 03 06:10:00.443026 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:00.442987    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:02.143405 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.143370    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:02.558424 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.558341    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main" containerID="cri-o://e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb" gracePeriod=41
Nov 03 06:10:02.644596 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.644567    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:02.801685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.801649    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:02.835986 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.835965    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:10:02.934575 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.934538    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-model-cache\") pod \"e5ec877e-00f3-4188-b250-43ee90143f9f\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") "
Nov 03 06:10:02.934752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.934609    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e5ec877e-00f3-4188-b250-43ee90143f9f-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ec877e-00f3-4188-b250-43ee90143f9f-tls-certs\") pod \"e5ec877e-00f3-4188-b250-43ee90143f9f\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") "
Nov 03 06:10:02.934752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.934670    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5ec877e-00f3-4188-b250-43ee90143f9f-kube-api-access-mwl7w\" (UniqueName: \"kubernetes.io/projected/e5ec877e-00f3-4188-b250-43ee90143f9f-kube-api-access-mwl7w\") pod \"e5ec877e-00f3-4188-b250-43ee90143f9f\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") "
Nov 03 06:10:02.934752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.934739    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-dshm\") pod \"e5ec877e-00f3-4188-b250-43ee90143f9f\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") "
Nov 03 06:10:02.934927 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.934856    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-model-cache" pod "e5ec877e-00f3-4188-b250-43ee90143f9f" (UID: "e5ec877e-00f3-4188-b250-43ee90143f9f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:02.935009 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.934990    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-home\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-home\") pod \"e5ec877e-00f3-4188-b250-43ee90143f9f\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") "
Nov 03 06:10:02.935066 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.935045    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-tmp-dir\") pod \"e5ec877e-00f3-4188-b250-43ee90143f9f\" (UID: \"e5ec877e-00f3-4188-b250-43ee90143f9f\") "
Nov 03 06:10:02.935462 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.935437    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-home" pod "e5ec877e-00f3-4188-b250-43ee90143f9f" (UID: "e5ec877e-00f3-4188-b250-43ee90143f9f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:02.935659 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.935612    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-tmp-dir" pod "e5ec877e-00f3-4188-b250-43ee90143f9f" (UID: "e5ec877e-00f3-4188-b250-43ee90143f9f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:02.935779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.935708    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:02.937599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.937494    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-dshm" pod "e5ec877e-00f3-4188-b250-43ee90143f9f" (UID: "e5ec877e-00f3-4188-b250-43ee90143f9f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:02.937884 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.937859    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5ec877e-00f3-4188-b250-43ee90143f9f-kube-api-access-mwl7w" pod "e5ec877e-00f3-4188-b250-43ee90143f9f" (UID: "e5ec877e-00f3-4188-b250-43ee90143f9f"). InnerVolumeSpecName "kube-api-access-mwl7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:02.938205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:02.938187    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5ec877e-00f3-4188-b250-43ee90143f9f-tls-certs" pod "e5ec877e-00f3-4188-b250-43ee90143f9f" (UID: "e5ec877e-00f3-4188-b250-43ee90143f9f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:03.037379 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.037346    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:03.037379 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.037380    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:03.037632 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.037394    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5ec877e-00f3-4188-b250-43ee90143f9f-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:03.037632 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.037405    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwl7w\" (UniqueName: \"kubernetes.io/projected/e5ec877e-00f3-4188-b250-43ee90143f9f-kube-api-access-mwl7w\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:03.037632 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.037416    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5ec877e-00f3-4188-b250-43ee90143f9f-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:03.149441 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.149411    4418 generic.go:356] "Generic (PLEG): container finished" podID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerID="e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb" exitCode=0
Nov 03 06:10:03.149863 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.149454    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"
Nov 03 06:10:03.149863 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.149496    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" event={"ID":"e5ec877e-00f3-4188-b250-43ee90143f9f","Type":"ContainerDied","Data":"e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb"}
Nov 03 06:10:03.149863 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.149565    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh" event={"ID":"e5ec877e-00f3-4188-b250-43ee90143f9f","Type":"ContainerDied","Data":"28e0816479266bacb75641a455d72e5a03f89f02db32d1c681f47a0f47b0c669"}
Nov 03 06:10:03.149863 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.149582    4418 scope.go:122] "RemoveContainer" containerID="e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb"
Nov 03 06:10:03.160657 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.160637    4418 scope.go:122] "RemoveContainer" containerID="e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb"
Nov 03 06:10:03.160990 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:03.160968    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb\": container with ID starting with e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb not found: ID does not exist" containerID="e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb"
Nov 03 06:10:03.161084 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.160997    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb"} err="failed to get container status \"e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb\": rpc error: code = NotFound desc = could not find container \"e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb\": container with ID starting with e19d1321f1721496abdf9a9497b237f38f1db768314c6269af7a993dff5411bb not found: ID does not exist"
Nov 03 06:10:03.201421 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.201387    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"]
Nov 03 06:10:03.213740 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.213698    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-b7e447/simulator-w3-b7e447-kserve-5b7c555d55-gwmrh"]
Nov 03 06:10:03.835358 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:03.835326    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:04.785027 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:04.784991    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" path="/var/lib/kubelet/pods/e5ec877e-00f3-4188-b250-43ee90143f9f/volumes"
Nov 03 06:10:04.893629 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:04.893597    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:05.736496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:05.736462    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:06.884308 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:06.884278    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:07.836944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:07.836879    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:09.159538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.159480    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"]
Nov 03 06:10:09.160155 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.160140    4418 cpu_manager.go:414] "containerMap: removing container" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main"
Nov 03 06:10:09.160205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.160156    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main"
Nov 03 06:10:09.160205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.160182    4418 cpu_manager.go:414] "containerMap: removing container" podUID="6d84786e-97c9-44b3-bbc7-bcb70c641534" containerName="revoke-keys"
Nov 03 06:10:09.160205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.160188    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d84786e-97c9-44b3-bbc7-bcb70c641534" containerName="revoke-keys"
Nov 03 06:10:09.160320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.160291    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5ec877e-00f3-4188-b250-43ee90143f9f" containerName="main"
Nov 03 06:10:09.160320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.160308    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d84786e-97c9-44b3-bbc7-bcb70c641534" containerName="revoke-keys"
Nov 03 06:10:09.165349 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.165331    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.190243 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.190217    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"]
Nov 03 06:10:09.219756 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.219717    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.219943 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.219772    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.219943 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.219891    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6019bcd0-2450-4042-ab89-10c5e8f43379-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.220070 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.219958    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvfp\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-kube-api-access-ffvfp\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.220070 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.220039    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.220192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.220170    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.220314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.220293    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.220370 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.220332    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.220462 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.220446    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.321820 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.321786    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6019bcd0-2450-4042-ab89-10c5e8f43379-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.321989 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.321840    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvfp\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-kube-api-access-ffvfp\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.321989 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.321885    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.321989 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.321947    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322094 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322049    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322094 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322076    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322160    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322244 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322229    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322258    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322531 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322471    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-data\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322668 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322569    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322668 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322610    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6019bcd0-2450-4042-ab89-10c5e8f43379-istiod-ca-cert\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322774 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322689    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-credential-socket\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.322774 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.322685    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-certs\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.324486 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.324462    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-envoy\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.324613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.324555    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-podinfo\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.344923 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.344892    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-token\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.345025 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.345006    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvfp\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-kube-api-access-ffvfp\") pod \"e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") " pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.479807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.479726    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:09.644789 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.644689    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:09.806845 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.806811    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"]
Nov 03 06:10:09.807722 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:09.807688    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6019bcd0_2450_4042_ab89_10c5e8f43379.slice/crio-82ec948998bcc27b74e347ab20a09d611fafdf1fcfbc07f298db144fecefccd3 WatchSource:0}: Error finding container 82ec948998bcc27b74e347ab20a09d611fafdf1fcfbc07f298db144fecefccd3: Status 404 returned error can't find the container with id 82ec948998bcc27b74e347ab20a09d611fafdf1fcfbc07f298db144fecefccd3
Nov 03 06:10:09.810320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.810286    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:09.810418 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.810351    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:09.810418 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:09.810376    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:10.197604 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:10.197558    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" event={"ID":"6019bcd0-2450-4042-ab89-10c5e8f43379","Type":"ContainerStarted","Data":"192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc"}
Nov 03 06:10:10.198167 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:10.197648    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" event={"ID":"6019bcd0-2450-4042-ab89-10c5e8f43379","Type":"ContainerStarted","Data":"82ec948998bcc27b74e347ab20a09d611fafdf1fcfbc07f298db144fecefccd3"}
Nov 03 06:10:10.244114 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:10.244063    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podStartSLOduration=1.244050039 podStartE2EDuration="1.244050039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:10:10.241200273 +0000 UTC m=+897.611150358" watchObservedRunningTime="2026-11-03 06:10:10.244050039 +0000 UTC m=+897.614000153"
Nov 03 06:10:10.481010 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:10.480926    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:10.482555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:10.482526    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:10.482680 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:10.482583    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:11.363015 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:11.362958    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:11.480949 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:11.480906    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:11.481359 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:11.481327    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:11.768755 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:11.768720    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"]
Nov 03 06:10:11.957954 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:11.957923    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:12.487228 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:12.486803    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:12.487228 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:12.486866    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:12.839259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:12.839163    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"]
Nov 03 06:10:12.839840 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:12.839811    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr" podUID="dba5e668-aed0-4dfd-8352-017b07a4558c" containerName="maas-api" containerID="cri-o://7af1051f2c7008f2671d98eea55d9594031910eac434430aeb35ce8949dd2de8" gracePeriod=30
Nov 03 06:10:12.950280 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:12.950071    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:13.247325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.247280    4418 generic.go:356] "Generic (PLEG): container finished" podID="dba5e668-aed0-4dfd-8352-017b07a4558c" containerID="7af1051f2c7008f2671d98eea55d9594031910eac434430aeb35ce8949dd2de8" exitCode=0
Nov 03 06:10:13.247610 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.247587    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr" event={"ID":"dba5e668-aed0-4dfd-8352-017b07a4558c","Type":"ContainerDied","Data":"7af1051f2c7008f2671d98eea55d9594031910eac434430aeb35ce8949dd2de8"}
Nov 03 06:10:13.520573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.505647    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:13.520573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.505712    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:13.565902 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.565869    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:13.705664 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.705637    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:10:13.738199 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.738168    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:13.924525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.924429    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls\") pod \"dba5e668-aed0-4dfd-8352-017b07a4558c\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") "
Nov 03 06:10:13.924745 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.924561    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dba5e668-aed0-4dfd-8352-017b07a4558c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba5e668-aed0-4dfd-8352-017b07a4558c-openshift-service-ca\") pod \"dba5e668-aed0-4dfd-8352-017b07a4558c\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") "
Nov 03 06:10:13.924745 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.924729    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dba5e668-aed0-4dfd-8352-017b07a4558c-kube-api-access-xst7g\" (UniqueName: \"kubernetes.io/projected/dba5e668-aed0-4dfd-8352-017b07a4558c-kube-api-access-xst7g\") pod \"dba5e668-aed0-4dfd-8352-017b07a4558c\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") "
Nov 03 06:10:13.924864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.924766    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-metrics-certs\") pod \"dba5e668-aed0-4dfd-8352-017b07a4558c\" (UID: \"dba5e668-aed0-4dfd-8352-017b07a4558c\") "
Nov 03 06:10:13.992072 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:13.969102    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dba5e668-aed0-4dfd-8352-017b07a4558c-openshift-service-ca" pod "dba5e668-aed0-4dfd-8352-017b07a4558c" (UID: "dba5e668-aed0-4dfd-8352-017b07a4558c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:14.030527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.001330    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-metrics-certs" pod "dba5e668-aed0-4dfd-8352-017b07a4558c" (UID: "dba5e668-aed0-4dfd-8352-017b07a4558c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:14.033617 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.033219    4418 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dba5e668-aed0-4dfd-8352-017b07a4558c-openshift-service-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:14.073467 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.073432    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba5e668-aed0-4dfd-8352-017b07a4558c-kube-api-access-xst7g" pod "dba5e668-aed0-4dfd-8352-017b07a4558c" (UID: "dba5e668-aed0-4dfd-8352-017b07a4558c"). InnerVolumeSpecName "kube-api-access-xst7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:14.073765 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.073738    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls" pod "dba5e668-aed0-4dfd-8352-017b07a4558c" (UID: "dba5e668-aed0-4dfd-8352-017b07a4558c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:14.147526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.140264    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xst7g\" (UniqueName: \"kubernetes.io/projected/dba5e668-aed0-4dfd-8352-017b07a4558c-kube-api-access-xst7g\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:14.175924 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.175842    4418 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-metrics-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:14.176141 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.176122    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dba5e668-aed0-4dfd-8352-017b07a4558c-maas-api-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:14.302729 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.302688    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:14.312532 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.309615    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr" event={"ID":"dba5e668-aed0-4dfd-8352-017b07a4558c","Type":"ContainerDied","Data":"283cdf7a1cf6cb872c10ad590471bce6aa6d7621f1cdd9f3f761ea16081d1bb0"}
Nov 03 06:10:14.312532 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.309685    4418 scope.go:122] "RemoveContainer" containerID="7af1051f2c7008f2671d98eea55d9594031910eac434430aeb35ce8949dd2de8"
Nov 03 06:10:14.312532 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.309847    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"
Nov 03 06:10:14.490527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.484550    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"]
Nov 03 06:10:14.490527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.484926    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:14.490527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.484987    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:14.494524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.493210    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-b7e447-6f88bbd67c-sncfr"]
Nov 03 06:10:14.809220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.809131    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:14.828584 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.828537    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dba5e668-aed0-4dfd-8352-017b07a4558c" path="/var/lib/kubelet/pods/dba5e668-aed0-4dfd-8352-017b07a4558c/volumes"
Nov 03 06:10:14.993683 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:14.993632    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Nov 03 06:10:15.047796 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.046606    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:15.150798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.149613    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Nov 03 06:10:15.177881 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.177838    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:15.236654 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.236601    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:15.441714 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.441611    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:10:15.463879 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.463834    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:15.497963 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.497924    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:15.498246 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.498217    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:15.662709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.662658    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:15.745134 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:15.745043    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": context deadline exceeded"
Nov 03 06:10:16.002745 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.002632    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:16.003811 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.003789    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:10:16.047186 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.047143    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 06:10:16.074521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.073029    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:10:16.177534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.153761    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:16.177534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.154567    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:10:16.215554 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.215514    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:16.216484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.216462    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:10:16.313589 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.247732    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:16.313589 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.248342    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:10:16.506536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.484673    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:16.506536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.485474    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:10:16.506536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.495469    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Nov 03 06:10:16.506536 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.495836    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:10:16.546604 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.507636    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:16.546604 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.507704    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:16.682992 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.682928    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:16.718966 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.718936    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:10:16.773001 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.745601    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": context deadline exceeded"
Nov 03 06:10:16.773001 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.746183    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:10:16.953558 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:16.953449    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/health\": context deadline exceeded"
Nov 03 06:10:17.017713 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.017661    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:17.236580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.227883    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 06:10:17.306414 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.302583    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:10:17.313531 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.307218    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Nov 03 06:10:17.334872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.334808    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:17.485595 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.485548    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:17.485902 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.485871    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:17.486552 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.486520    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:17.511637 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.511533    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:17.618790 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.524799    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:10:17.692253 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.688889    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Nov 03 06:10:17.717597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.717298    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:17.717597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.717380    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:17.803549 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:17.803428    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/health\": context deadline exceeded"
Nov 03 06:10:18.023531 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.021601    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.039528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.039007    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:18.039528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.039069    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.142646 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.133672    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:18.231814 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.230592    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.321181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.319704    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.321181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.320040    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:10:18.337540 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.335633    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.345619 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.345584    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:18.345889 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.345858    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.405494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.396969    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.438761 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.438596    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:18.438761 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.438690    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.485489 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.485451    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:18.485791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.485744    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:18.491658 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.491588    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.669336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.669229    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.706618 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.691324    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:18.788528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:18.772635    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.003707 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.003609    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:19.005003 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.004970    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.017563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.017496    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:19.017850 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.017810    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.030170 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.030041    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.231655 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.231604    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.323699 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.323581    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.325098 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.325066    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.336643 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.336604    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/health\": context deadline exceeded"
Nov 03 06:10:19.336926 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.336902    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.410531 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.408604    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": context deadline exceeded"
Nov 03 06:10:19.410531 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.409373    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:10:19.482055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.482014    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:19.482343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.482316    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:19.493860 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.493825    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:10:19.672072 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.670914    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.684740 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.684603    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:19.684740 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.684671    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.694323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.693962    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": context deadline exceeded"
Nov 03 06:10:19.707977 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.707889    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.915242 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.915198    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:19.941288 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:19.941189    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:20.034654 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.034605    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": context deadline exceeded"
Nov 03 06:10:20.236063 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.235955    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:20.329838 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.328603    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Nov 03 06:10:20.330204 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.330122    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:10:20.343039 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.342943    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:10:20.408392 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.408342    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/health\": context deadline exceeded"
Nov 03 06:10:20.411021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.410975    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:20.480537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.478617    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:20.480537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.478688    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:20.481670 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.481642    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:20.481855 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.481832    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:20.496905 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.496807    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:20.678347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.676870    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Nov 03 06:10:20.699770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.699727    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:20.700213 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.700089    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:20.700645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.700621    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:20.968523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:20.943214    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:21.065569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.060541    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:21.173244 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.173212    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:21.236744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.236641    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:21.329029 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.328970    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:21.330518 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.330473    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": context deadline exceeded"
Nov 03 06:10:21.350183 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.350128    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": context deadline exceeded"
Nov 03 06:10:21.414880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.414804    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:21.515294 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.514100    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:21.515294 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.514169    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:21.515294 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.514583    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" probeResult="failure" output="Get \"https://10.134.0.68:8000/ready\": context deadline exceeded"
Nov 03 06:10:21.649310 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.649280    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:21.678483 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.678444    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:21.686437 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.680147    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:10:21.708569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.708127    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:21.879646 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.875586    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:21.966538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:21.901047    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:10:22.039923 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.039894    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:10:22.064108 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.064064    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:22.089942 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.073204    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:10:22.113769 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.095539    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:22.157868 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.157771    4418 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:22.169101 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.169065    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:10:22.301906 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.301876    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:10:22.351603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.351562    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:22.364112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.364084    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:10:22.380275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.380243    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:10:22.381857 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.381832    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:10:22.445570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.440915    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:22.480701 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.480664    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Nov 03 06:10:22.481078 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.481014    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Nov 03 06:10:22.629245 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.628996    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:22.704580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.701551    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"]
Nov 03 06:10:22.704580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.701806    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy" containerID="cri-o://89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152" gracePeriod=30
Nov 03 06:10:22.735785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.735755    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"]
Nov 03 06:10:22.736283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.736249    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy" containerID="cri-o://b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54" gracePeriod=30
Nov 03 06:10:22.744413 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.744383    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"]
Nov 03 06:10:22.744810 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.744778    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy" containerID="cri-o://00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57" gracePeriod=30
Nov 03 06:10:22.821122 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:22.820612    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:23.038346 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:23.033631    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"]
Nov 03 06:10:23.231012 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:23.230979    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:24.480368 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.480331    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:24.522648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.522597    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:10:24.522860 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.522675    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:24.873626 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.873590    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"]
Nov 03 06:10:24.889706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.889666    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"]
Nov 03 06:10:24.890877 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.890849    4418 cpu_manager.go:414] "containerMap: removing container" podUID="dba5e668-aed0-4dfd-8352-017b07a4558c" containerName="maas-api"
Nov 03 06:10:24.890877 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.890876    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba5e668-aed0-4dfd-8352-017b07a4558c" containerName="maas-api"
Nov 03 06:10:24.891070 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.891041    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="dba5e668-aed0-4dfd-8352-017b07a4558c" containerName="maas-api"
Nov 03 06:10:24.898721 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.898695    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:24.905101 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.904407    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"]
Nov 03 06:10:24.924239 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.924208    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"]
Nov 03 06:10:24.932330 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.932297    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 06:10:24.932464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.932418    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rxh5n\""
Nov 03 06:10:24.970549 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.970488    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-xks-ca\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:24.970767 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.970746    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:24.970927 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:24.970908    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqqq\" (UniqueName: \"kubernetes.io/projected/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-kube-api-access-skqqq\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.072332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.072273    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skqqq\" (UniqueName: \"kubernetes.io/projected/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-kube-api-access-skqqq\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.072553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.072337    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-xks-ca\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.072626 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.072561    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.073477 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.073450    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.074906 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.074880    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-xks-ca\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.101687 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.101657    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqqq\" (UniqueName: \"kubernetes.io/projected/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-kube-api-access-skqqq\") pod \"maas-api-revoke-sub-af4454f2-r8dbz\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.103320 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.103273    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:25.192732 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.192651    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:25.194223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.194198    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:10:25.245377 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.245353    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:25.465182 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.465084    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:25.582555 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:25.582468    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce7fc8f_9aad_4cf1_9a49_bf91bcab9811.slice/crio-ff0652c7c294aa3a17518f9211d6cf3678b1df60efbb518684e0c178ced82ca2 WatchSource:0}: Error finding container ff0652c7c294aa3a17518f9211d6cf3678b1df60efbb518684e0c178ced82ca2: Status 404 returned error can't find the container with id ff0652c7c294aa3a17518f9211d6cf3678b1df60efbb518684e0c178ced82ca2
Nov 03 06:10:25.582555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:25.582526    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"]
Nov 03 06:10:26.155826 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:26.155791    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz" event={"ID":"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811","Type":"ContainerStarted","Data":"36fd508fe5bac752aacef45b9c489dadbc5ca6e4203f3937ae88268f5cf97b4a"}
Nov 03 06:10:26.156010 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:26.155844    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz" event={"ID":"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811","Type":"ContainerStarted","Data":"ff0652c7c294aa3a17518f9211d6cf3678b1df60efbb518684e0c178ced82ca2"}
Nov 03 06:10:26.203101 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:26.203044    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz" podStartSLOduration=2.203024632 podStartE2EDuration="2.203024632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:10:26.199564143 +0000 UTC m=+913.569514227" watchObservedRunningTime="2026-11-03 06:10:26.203024632 +0000 UTC m=+913.572974717"
Nov 03 06:10:26.819433 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:26.819336    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main" containerID="cri-o://30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3" gracePeriod=45
Nov 03 06:10:27.093146 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.093122    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:10:27.165709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.165664    4418 generic.go:356] "Generic (PLEG): container finished" podID="cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" containerID="36fd508fe5bac752aacef45b9c489dadbc5ca6e4203f3937ae88268f5cf97b4a" exitCode=0
Nov 03 06:10:27.165893 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.165750    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz" event={"ID":"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811","Type":"ContainerDied","Data":"36fd508fe5bac752aacef45b9c489dadbc5ca6e4203f3937ae88268f5cf97b4a"}
Nov 03 06:10:27.167581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.167557    4418 generic.go:356] "Generic (PLEG): container finished" podID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerID="30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3" exitCode=0
Nov 03 06:10:27.167748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.167608    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"
Nov 03 06:10:27.167748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.167644    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" event={"ID":"b6f614c3-4bac-48bb-9edb-a60166b5a4fb","Type":"ContainerDied","Data":"30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3"}
Nov 03 06:10:27.167748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.167686    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt" event={"ID":"b6f614c3-4bac-48bb-9edb-a60166b5a4fb","Type":"ContainerDied","Data":"e81a98e83fff9994dad34e29e219ca90f168e19cd26c43370756e71693b08837"}
Nov 03 06:10:27.167748 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.167708    4418 scope.go:122] "RemoveContainer" containerID="30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3"
Nov 03 06:10:27.182176 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.181825    4418 scope.go:122] "RemoveContainer" containerID="30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3"
Nov 03 06:10:27.182176 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:27.182115    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3\": container with ID starting with 30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3 not found: ID does not exist" containerID="30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3"
Nov 03 06:10:27.182176 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.182142    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3"} err="failed to get container status \"30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3\": rpc error: code = NotFound desc = could not find container \"30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3\": container with ID starting with 30e313955705270cc647116265091e964f7ab4d349754ac68f5f08382c0678b3 not found: ID does not exist"
Nov 03 06:10:27.203480 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.203456    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-dshm\") pod \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") "
Nov 03 06:10:27.203653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.203583    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-home\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-home\") pod \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") "
Nov 03 06:10:27.203653 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.203630    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tmp-dir\") pod \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") "
Nov 03 06:10:27.203784 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.203715    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tls-certs\") pod \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") "
Nov 03 06:10:27.203784 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.203771    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-kube-api-access-wc8rh\" (UniqueName: \"kubernetes.io/projected/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-kube-api-access-wc8rh\") pod \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") "
Nov 03 06:10:27.203899 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.203872    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-home" pod "b6f614c3-4bac-48bb-9edb-a60166b5a4fb" (UID: "b6f614c3-4bac-48bb-9edb-a60166b5a4fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:27.203961 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.203918    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tmp-dir" pod "b6f614c3-4bac-48bb-9edb-a60166b5a4fb" (UID: "b6f614c3-4bac-48bb-9edb-a60166b5a4fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:27.204040 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.204020    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-model-cache\") pod \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\" (UID: \"b6f614c3-4bac-48bb-9edb-a60166b5a4fb\") "
Nov 03 06:10:27.204252 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.204210    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-model-cache" pod "b6f614c3-4bac-48bb-9edb-a60166b5a4fb" (UID: "b6f614c3-4bac-48bb-9edb-a60166b5a4fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:27.204677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.204656    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:27.204772 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.204680    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:27.204772 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.204692    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:27.206418 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.206393    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tls-certs" pod "b6f614c3-4bac-48bb-9edb-a60166b5a4fb" (UID: "b6f614c3-4bac-48bb-9edb-a60166b5a4fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:27.206635 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.206611    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-kube-api-access-wc8rh" pod "b6f614c3-4bac-48bb-9edb-a60166b5a4fb" (UID: "b6f614c3-4bac-48bb-9edb-a60166b5a4fb"). InnerVolumeSpecName "kube-api-access-wc8rh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:27.206738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.206710    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-dshm" pod "b6f614c3-4bac-48bb-9edb-a60166b5a4fb" (UID: "b6f614c3-4bac-48bb-9edb-a60166b5a4fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:27.306323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.306284    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:27.306323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.306313    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:27.306323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.306326    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc8rh\" (UniqueName: \"kubernetes.io/projected/b6f614c3-4bac-48bb-9edb-a60166b5a4fb-kube-api-access-wc8rh\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:27.516114 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.516084    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"]
Nov 03 06:10:27.528334 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.528307    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-ba6892/distinct-2-w5-ba6892-kserve-cbf76df79-455gt"]
Nov 03 06:10:27.599447 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:27.599403    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:28.034240 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.034177    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:10:28.117661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117635    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-certs\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.117827 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117721    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-kube-api-access-j8rsd\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-kube-api-access-j8rsd\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.117827 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117759    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/08a35ec3-7700-4282-ac87-050323cec75e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08a35ec3-7700-4282-ac87-050323cec75e-istio-podinfo\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.117941 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117841    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-envoy\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.117941 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117894    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-socket\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.117941 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117930    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-data\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.118088 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117976    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/08a35ec3-7700-4282-ac87-050323cec75e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08a35ec3-7700-4282-ac87-050323cec75e-istiod-ca-cert\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.118088 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.118047    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-credential-socket\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.118192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.118128    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-istio-token\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-istio-token\") pod \"08a35ec3-7700-4282-ac87-050323cec75e\" (UID: \"08a35ec3-7700-4282-ac87-050323cec75e\") "
Nov 03 06:10:28.118192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.117922    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-certs" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.118904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.118631    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-credential-socket" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.118904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.118719    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-data" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.118904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.118842    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.118904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.118854    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.118904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.118864    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.119220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.119005    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08a35ec3-7700-4282-ac87-050323cec75e-istiod-ca-cert" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:28.119220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.119055    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-socket" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.121326 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.121196    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08a35ec3-7700-4282-ac87-050323cec75e-istio-podinfo" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:10:28.121468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.121398    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-kube-api-access-j8rsd" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "kube-api-access-j8rsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:28.122749 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.122636    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-istio-token" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:28.122749 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.122702    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-envoy" pod "08a35ec3-7700-4282-ac87-050323cec75e" (UID: "08a35ec3-7700-4282-ac87-050323cec75e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.161224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.160885    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:10:28.163474 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.163449    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:10:28.181845 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.181816    4418 generic.go:356] "Generic (PLEG): container finished" podID="08a35ec3-7700-4282-ac87-050323cec75e" containerID="00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57" exitCode=0
Nov 03 06:10:28.182178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.181914    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"
Nov 03 06:10:28.182178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.181930    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" event={"ID":"08a35ec3-7700-4282-ac87-050323cec75e","Type":"ContainerDied","Data":"00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57"}
Nov 03 06:10:28.182178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.181984    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8" event={"ID":"08a35ec3-7700-4282-ac87-050323cec75e","Type":"ContainerDied","Data":"d66bfe66598ed9876ca3214f949adf7147ff76e34451542b135e1f08e1ff9d14"}
Nov 03 06:10:28.182178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.182001    4418 scope.go:122] "RemoveContainer" containerID="00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57"
Nov 03 06:10:28.192284 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.191910    4418 generic.go:356] "Generic (PLEG): container finished" podID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerID="89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152" exitCode=0
Nov 03 06:10:28.192284 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.192023    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"
Nov 03 06:10:28.192284 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.192127    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" event={"ID":"8dad292a-0c05-4c75-bd7b-3b230ea29bfb","Type":"ContainerDied","Data":"89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152"}
Nov 03 06:10:28.192284 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.192158    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4" event={"ID":"8dad292a-0c05-4c75-bd7b-3b230ea29bfb","Type":"ContainerDied","Data":"01a2f5973fb5d7f72394f80295346dc2fc44ab5f229ffb7c19e0c4e0a58c46de"}
Nov 03 06:10:28.194898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.193750    4418 generic.go:356] "Generic (PLEG): container finished" podID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerID="b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54" exitCode=0
Nov 03 06:10:28.194898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.193967    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"
Nov 03 06:10:28.194898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.194064    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" event={"ID":"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2","Type":"ContainerDied","Data":"b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54"}
Nov 03 06:10:28.194898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.194091    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk" event={"ID":"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2","Type":"ContainerDied","Data":"0c7500f8df4fc37416ca175e5c001185cbd004844d693618c419ec01c1d0f139"}
Nov 03 06:10:28.202697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.202679    4418 scope.go:122] "RemoveContainer" containerID="00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57"
Nov 03 06:10:28.203023 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:28.203000    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57\": container with ID starting with 00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57 not found: ID does not exist" containerID="00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57"
Nov 03 06:10:28.203130 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.203035    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57"} err="failed to get container status \"00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57\": rpc error: code = NotFound desc = could not find container \"00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57\": container with ID starting with 00bdab640fdc9607911159412fc2b38b33f963e67505f9ca4f0f25d48da1ff57 not found: ID does not exist"
Nov 03 06:10:28.203130 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.203057    4418 scope.go:122] "RemoveContainer" containerID="89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152"
Nov 03 06:10:28.219994 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.219961    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-podinfo\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220072    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-credential-socket\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220133    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-socket\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220169    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-certs\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220242 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220225    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-socket\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220313 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220296    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-credential-socket\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220348 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220332    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-envoy\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220425 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220401    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istiod-ca-cert\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220467 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220451    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-token\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-token\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220598 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220545    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-data\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220598 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220583    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istiod-ca-cert\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220689 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220619    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-kube-api-access-x48sr\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-kube-api-access-x48sr\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220689 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220673    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-data\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220758 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220734    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-certs\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220813 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220798    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-podinfo\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.220904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220869    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-kube-api-access-tqrc2\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-kube-api-access-tqrc2\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.220975 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220962    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-envoy\") pod \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\" (UID: \"8dad292a-0c05-4c75-bd7b-3b230ea29bfb\") "
Nov 03 06:10:28.221034 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.220995    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-token\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-token\") pod \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\" (UID: \"c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2\") "
Nov 03 06:10:28.221796 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.221773    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8rsd\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-kube-api-access-j8rsd\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.221842 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.221803    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08a35ec3-7700-4282-ac87-050323cec75e-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.221842 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.221818    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.221842 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.221833    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08a35ec3-7700-4282-ac87-050323cec75e-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.221927 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.221846    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08a35ec3-7700-4282-ac87-050323cec75e-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.221927 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.221861    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08a35ec3-7700-4282-ac87-050323cec75e-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.223203 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.223178    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-data" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.224321 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.224228    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-socket" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.224519 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.224472    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-data" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.224519 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.224482    4418 scope.go:122] "RemoveContainer" containerID="89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152"
Nov 03 06:10:28.224867 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.224844    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istiod-ca-cert" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:28.224980 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.224939    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-socket" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.225108 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.225022    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istiod-ca-cert" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:28.225108 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.225082    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-credential-socket" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.225237 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.225219    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-certs" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.225463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.225442    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-credential-socket" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.225567 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.225536    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-certs" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.225691 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.225667    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-token" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:28.228321 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.228287    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-envoy" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.228413 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.228391    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-envoy" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:28.229374 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.229348    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-podinfo" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:10:28.229621 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.229602    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-podinfo" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:10:28.230930 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.230904    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-token" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:28.230930 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:28.230915    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152\": container with ID starting with 89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152 not found: ID does not exist" containerID="89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152"
Nov 03 06:10:28.231079 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.230948    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152"} err="failed to get container status \"89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152\": rpc error: code = NotFound desc = could not find container \"89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152\": container with ID starting with 89e9d948a85e3169a746a9a50adbc6269514b31e61727d40c3034d7652a1f152 not found: ID does not exist"
Nov 03 06:10:28.231079 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.230973    4418 scope.go:122] "RemoveContainer" containerID="b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54"
Nov 03 06:10:28.231189 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.231158    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-kube-api-access-tqrc2" pod "8dad292a-0c05-4c75-bd7b-3b230ea29bfb" (UID: "8dad292a-0c05-4c75-bd7b-3b230ea29bfb"). InnerVolumeSpecName "kube-api-access-tqrc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:28.231780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.231756    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-kube-api-access-x48sr" pod "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" (UID: "c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2"). InnerVolumeSpecName "kube-api-access-x48sr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:28.248361 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.248250    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"]
Nov 03 06:10:28.254175 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.254151    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-dt5n8"]
Nov 03 06:10:28.256618 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.256601    4418 scope.go:122] "RemoveContainer" containerID="b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54"
Nov 03 06:10:28.257013 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:28.256934    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54\": container with ID starting with b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54 not found: ID does not exist" containerID="b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54"
Nov 03 06:10:28.257013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.256960    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54"} err="failed to get container status \"b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54\": rpc error: code = NotFound desc = could not find container \"b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54\": container with ID starting with b877b644454f934dea5c541de526f872b5a13354c6942aecc4888da588ca2d54 not found: ID does not exist"
Nov 03 06:10:28.331336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331252    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331290    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331310    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331327    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqrc2\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-kube-api-access-tqrc2\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331342    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331354    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331367    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331380    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331395    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331408    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331421    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331434    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331448    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331461    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331474    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331540    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331559    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dad292a-0c05-4c75-bd7b-3b230ea29bfb-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.331671 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.331572    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x48sr\" (UniqueName: \"kubernetes.io/projected/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2-kube-api-access-x48sr\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.371730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.371706    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:28.405166 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:28.405137    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:10:28.433046 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.433021    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-openshift-ca\") pod \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") "
Nov 03 06:10:28.433218 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.433087    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-kube-api-access-skqqq\" (UniqueName: \"kubernetes.io/projected/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-kube-api-access-skqqq\") pod \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") "
Nov 03 06:10:28.433218 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.433124    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-xks-ca\") pod \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\" (UID: \"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811\") "
Nov 03 06:10:28.433486 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.433457    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-openshift-ca" pod "cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" (UID: "cce7fc8f-9aad-4cf1-9a49-bf91bcab9811"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:28.433703 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.433654    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-openshift-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.435384 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.435355    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-kube-api-access-skqqq" pod "cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" (UID: "cce7fc8f-9aad-4cf1-9a49-bf91bcab9811"). InnerVolumeSpecName "kube-api-access-skqqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:28.435624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.435583    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-xks-ca" pod "cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" (UID: "cce7fc8f-9aad-4cf1-9a49-bf91bcab9811"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:28.524823 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:28.524788    4418 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b7d7eb_9a09_4269_bd4a_35691d8e6cf2.slice/crio-0c7500f8df4fc37416ca175e5c001185cbd004844d693618c419ec01c1d0f139\": RecentStats: unable to find data in memory cache]"
Nov 03 06:10:28.534636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.534615    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skqqq\" (UniqueName: \"kubernetes.io/projected/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-kube-api-access-skqqq\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.534636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.534638    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811-maas-api-xks-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:28.549116 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.549086    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"]
Nov 03 06:10:28.552606 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.552586    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-nznhk"]
Nov 03 06:10:28.585255 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.585198    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"]
Nov 03 06:10:28.589559 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.589533    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-b7e447-openshift-default-7c59b58bd5-cr2f4"]
Nov 03 06:10:28.784033 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.784002    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="08a35ec3-7700-4282-ac87-050323cec75e" path="/var/lib/kubelet/pods/08a35ec3-7700-4282-ac87-050323cec75e/volumes"
Nov 03 06:10:28.784511 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.784488    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" path="/var/lib/kubelet/pods/8dad292a-0c05-4c75-bd7b-3b230ea29bfb/volumes"
Nov 03 06:10:28.784912 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.784899    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" path="/var/lib/kubelet/pods/b6f614c3-4bac-48bb-9edb-a60166b5a4fb/volumes"
Nov 03 06:10:28.785673 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:28.785652    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" path="/var/lib/kubelet/pods/c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2/volumes"
Nov 03 06:10:29.202463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:29.202433    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"
Nov 03 06:10:29.202463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:29.202453    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz" event={"ID":"cce7fc8f-9aad-4cf1-9a49-bf91bcab9811","Type":"ContainerDied","Data":"ff0652c7c294aa3a17518f9211d6cf3678b1df60efbb518684e0c178ced82ca2"}
Nov 03 06:10:29.203068 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:29.202534    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff0652c7c294aa3a17518f9211d6cf3678b1df60efbb518684e0c178ced82ca2"
Nov 03 06:10:29.407694 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:29.407643    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:31.126072 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:31.126028    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"]
Nov 03 06:10:31.130901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:31.130811    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:31.315520 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:31.314446    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:31.480629 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:31.480488    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:32.726649 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:32.726616    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"]
Nov 03 06:10:32.919909 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:32.919876    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:33.112347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:33.112271    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:34.348553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:34.348520    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:34.535685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:34.535647    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:34.997967 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:34.997934    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:35.912552 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:35.912518    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:36.127468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:36.127422    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" podUID="538fb4be-1740-4814-b31e-ca5fdc22b819" containerName="payload-processing" containerID="cri-o://a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63" gracePeriod=25
Nov 03 06:10:36.136589 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:36.136557    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:36.737385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:36.737347    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:37.727609 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.727569    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" podUID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" containerName="payload-pre-processing" containerID="cri-o://41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34" gracePeriod=25
Nov 03 06:10:37.774707 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.774672    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:37.925591 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.925557    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"]
Nov 03 06:10:37.926112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926099    4418 cpu_manager.go:414] "containerMap: removing container" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy"
Nov 03 06:10:37.926160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926113    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy"
Nov 03 06:10:37.926160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926124    4418 cpu_manager.go:414] "containerMap: removing container" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main"
Nov 03 06:10:37.926160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926129    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main"
Nov 03 06:10:37.926275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926166    4418 cpu_manager.go:414] "containerMap: removing container" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy"
Nov 03 06:10:37.926275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926172    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy"
Nov 03 06:10:37.926275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926179    4418 cpu_manager.go:414] "containerMap: removing container" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy"
Nov 03 06:10:37.926275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926184    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy"
Nov 03 06:10:37.926275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926190    4418 cpu_manager.go:414] "containerMap: removing container" podUID="cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" containerName="revoke-keys"
Nov 03 06:10:37.926275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926194    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" containerName="revoke-keys"
Nov 03 06:10:37.926275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926271    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2b7d7eb-9a09-4269-bd4a-35691d8e6cf2" containerName="istio-proxy"
Nov 03 06:10:37.926541 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926278    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="8dad292a-0c05-4c75-bd7b-3b230ea29bfb" containerName="istio-proxy"
Nov 03 06:10:37.926541 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926285    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" containerName="revoke-keys"
Nov 03 06:10:37.926541 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926291    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="08a35ec3-7700-4282-ac87-050323cec75e" containerName="istio-proxy"
Nov 03 06:10:37.926541 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.926296    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6f614c3-4bac-48bb-9edb-a60166b5a4fb" containerName="main"
Nov 03 06:10:37.930081 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.930066    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:37.944905 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.944886    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 06:10:37.945126 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.945111    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rxh5n\""
Nov 03 06:10:37.974174 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.973971    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:37.979737 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:37.979659    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"]
Nov 03 06:10:38.081864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.081821    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" containerID="cri-o://946d5744cc6fc09744572b3c1b7b087aa2bd8f876dd50741466d610277229ef2" gracePeriod=45
Nov 03 06:10:38.101558 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.101525    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k47b\" (UniqueName: \"kubernetes.io/projected/8d005559-722f-4a24-ab66-6a8ff953670a-kube-api-access-5k47b\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.101888 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.101820    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.102011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.101968    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.148015 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.147968    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:38.203455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.203419    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k47b\" (UniqueName: \"kubernetes.io/projected/8d005559-722f-4a24-ab66-6a8ff953670a-kube-api-access-5k47b\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.203710 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.203691    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.203782 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.203760    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.204313 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.204290    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.206160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.206131    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.235687 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.235492    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k47b\" (UniqueName: \"kubernetes.io/projected/8d005559-722f-4a24-ab66-6a8ff953670a-kube-api-access-5k47b\") pod \"maas-api-revoke-sub-60b851a1-28cgn\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.243885 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.243858    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:38.329301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.328729    4418 generic.go:356] "Generic (PLEG): container finished" podID="29455561-7928-4756-a42c-8c2871ab2d80" containerID="946d5744cc6fc09744572b3c1b7b087aa2bd8f876dd50741466d610277229ef2" exitCode=0
Nov 03 06:10:38.329301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.328940    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" event={"ID":"29455561-7928-4756-a42c-8c2871ab2d80","Type":"ContainerDied","Data":"946d5744cc6fc09744572b3c1b7b087aa2bd8f876dd50741466d610277229ef2"}
Nov 03 06:10:38.411524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.410037    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.510487    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-dshm\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-dshm\") pod \"29455561-7928-4756-a42c-8c2871ab2d80\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") "
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.510712    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-tmp-dir\") pod \"29455561-7928-4756-a42c-8c2871ab2d80\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") "
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.510751    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-model-cache\") pod \"29455561-7928-4756-a42c-8c2871ab2d80\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") "
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.510870    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29455561-7928-4756-a42c-8c2871ab2d80-tls-certs\" (UniqueName: \"kubernetes.io/secret/29455561-7928-4756-a42c-8c2871ab2d80-tls-certs\") pod \"29455561-7928-4756-a42c-8c2871ab2d80\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") "
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.510944    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29455561-7928-4756-a42c-8c2871ab2d80-kube-api-access-vjm2h\" (UniqueName: \"kubernetes.io/projected/29455561-7928-4756-a42c-8c2871ab2d80-kube-api-access-vjm2h\") pod \"29455561-7928-4756-a42c-8c2871ab2d80\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") "
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.511036    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-home\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-home\") pod \"29455561-7928-4756-a42c-8c2871ab2d80\" (UID: \"29455561-7928-4756-a42c-8c2871ab2d80\") "
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.511926    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-home" pod "29455561-7928-4756-a42c-8c2871ab2d80" (UID: "29455561-7928-4756-a42c-8c2871ab2d80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.513190    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-tmp-dir" pod "29455561-7928-4756-a42c-8c2871ab2d80" (UID: "29455561-7928-4756-a42c-8c2871ab2d80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.513413    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-model-cache" pod "29455561-7928-4756-a42c-8c2871ab2d80" (UID: "29455561-7928-4756-a42c-8c2871ab2d80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.513875    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:38.519137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.516820    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-dshm" pod "29455561-7928-4756-a42c-8c2871ab2d80" (UID: "29455561-7928-4756-a42c-8c2871ab2d80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:38.521790 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.521760    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29455561-7928-4756-a42c-8c2871ab2d80-tls-certs" pod "29455561-7928-4756-a42c-8c2871ab2d80" (UID: "29455561-7928-4756-a42c-8c2871ab2d80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:38.523144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.523121    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29455561-7928-4756-a42c-8c2871ab2d80-kube-api-access-vjm2h" pod "29455561-7928-4756-a42c-8c2871ab2d80" (UID: "29455561-7928-4756-a42c-8c2871ab2d80"). InnerVolumeSpecName "kube-api-access-vjm2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:38.604377 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.604346    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"]
Nov 03 06:10:38.661129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.650304    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:38.661129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.661017    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:38.661129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.661042    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:38.661129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.661056    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29455561-7928-4756-a42c-8c2871ab2d80-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:38.661129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.661069    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29455561-7928-4756-a42c-8c2871ab2d80-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:38.661129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:38.661083    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjm2h\" (UniqueName: \"kubernetes.io/projected/29455561-7928-4756-a42c-8c2871ab2d80-kube-api-access-vjm2h\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:39.013399 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.013370    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:39.307551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.307491    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:39.337005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.336976    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn" event={"ID":"8d005559-722f-4a24-ab66-6a8ff953670a","Type":"ContainerStarted","Data":"e729f2c0a6ee4e2262277d863b4e72a3485972c10abf8945374882c15fda7529"}
Nov 03 06:10:39.337154 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.337033    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn" event={"ID":"8d005559-722f-4a24-ab66-6a8ff953670a","Type":"ContainerStarted","Data":"1e669fc907de2d6f5b6ebdcf52f0ca380899b57677d30ae359c20eb1e193abea"}
Nov 03 06:10:39.348375 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.348340    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff" event={"ID":"29455561-7928-4756-a42c-8c2871ab2d80","Type":"ContainerDied","Data":"add5f3777972ff0fa211f1a847830b71af33a1226834ebd701515511c1c1319f"}
Nov 03 06:10:39.348485 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.348382    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"
Nov 03 06:10:39.348970 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.348389    4418 scope.go:122] "RemoveContainer" containerID="946d5744cc6fc09744572b3c1b7b087aa2bd8f876dd50741466d610277229ef2"
Nov 03 06:10:39.388562 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.388480    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn" podStartSLOduration=2.388459084 podStartE2EDuration="2.388459084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:10:39.387180705 +0000 UTC m=+926.757130788" watchObservedRunningTime="2026-11-03 06:10:39.388459084 +0000 UTC m=+926.758409235"
Nov 03 06:10:39.426235 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.426208    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"]
Nov 03 06:10:39.431292 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.431270    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-be1a66/premium-w4-be1a66-kserve-847765b9f5-p7fff"]
Nov 03 06:10:39.684459 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.684428    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"]
Nov 03 06:10:39.685083 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.685066    4418 cpu_manager.go:414] "containerMap: removing container" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main"
Nov 03 06:10:39.685127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.685085    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main"
Nov 03 06:10:39.685223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.685213    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="29455561-7928-4756-a42c-8c2871ab2d80" containerName="main"
Nov 03 06:10:39.688737 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.688717    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.718121 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.718100    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"]
Nov 03 06:10:39.763527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.763468    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"]
Nov 03 06:10:39.775631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775389    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84e6cf40-6ada-41c2-b797-c62c74c1c862-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.775631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775433    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.775631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775589    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.775925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775659    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.775925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775764    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.775925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775806    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-492dn\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-kube-api-access-492dn\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.775925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775837    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.775925 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775856    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.776201 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.775955    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.776477 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.776453    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.804266 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.804231    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"]
Nov 03 06:10:39.858692 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.858664    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"]
Nov 03 06:10:39.863428 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.863407    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.877710 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.877681    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84e6cf40-6ada-41c2-b797-c62c74c1c862-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.877832 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.877731    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.877832 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.877762    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.877832 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.877808    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.877931    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0a6235-7bfe-408f-a725-3e17537ea9ab-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.877957    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878025    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.878105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878056    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.878105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878090    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.878263 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878148    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-492dn\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-kube-api-access-492dn\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.878263 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878207    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.878263 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878232    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.878404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878278    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75slz\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-kube-api-access-75slz\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878339    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878385    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878471    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878540    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.878696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.878582    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.879074 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.879046    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.879803 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.879778    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84e6cf40-6ada-41c2-b797-c62c74c1c862-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.880494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.880466    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.880820 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.880798    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.881144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.880970    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.882465 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.882442    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.883269 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.883241    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.892171 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.892149    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"]
Nov 03 06:10:39.905297 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.905266    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-492dn\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-kube-api-access-492dn\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.905989 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.905953    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main" containerID="cri-o://3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa" gracePeriod=45
Nov 03 06:10:39.907591 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.907567    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:39.970669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.970588    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main" containerID="cri-o://33c9dab94f0dfaf51aa1ece6d8c164ee2a8d0bd5f3ead83d7244ae61a67ac680" gracePeriod=45
Nov 03 06:10:39.980608 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980576    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980695    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75slz\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-kube-api-access-75slz\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980745    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980776    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980800    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980869    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980918    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.980964    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981033    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981071    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981181    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981242    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981282    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981292    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981236    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-certs\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981326    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295cd236-273a-41d4-b1ce-be6d1690a33c-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981384    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-credential-socket\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981538    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981604    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0a6235-7bfe-408f-a725-3e17537ea9ab-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981607    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-data\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.981675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981642    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.982206 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.981681    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr6mp\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-kube-api-access-tr6mp\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:39.982283 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.982264    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0a6235-7bfe-408f-a725-3e17537ea9ab-istiod-ca-cert\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.983462 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.983441    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-podinfo\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:39.983788 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:39.983764    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-envoy\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:40.002181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.002161    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:40.004271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.004248    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-token\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:40.004429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.004409    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75slz\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-kube-api-access-75slz\") pod \"e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") " pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:40.072631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.072601    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"]
Nov 03 06:10:40.078362 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.078001    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.083445    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.083540    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr6mp\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-kube-api-access-tr6mp\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084006    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-certs\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084049    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084120    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084151    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084212    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084247    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084341    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.084539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.084378    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295cd236-273a-41d4-b1ce-be6d1690a33c-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.085083 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.085040    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295cd236-273a-41d4-b1ce-be6d1690a33c-istiod-ca-cert\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.085588 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.085266    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-data\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.089690 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.089297    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-credential-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.089690 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.089353    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-socket\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.089690 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.089645    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-podinfo\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.093784 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.093717    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-envoy\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.098599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.098577    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"]
Nov 03 06:10:40.105581 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.105534    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:40.126430 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.123144    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr6mp\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-kube-api-access-tr6mp\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.126430 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.126199    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:40.128434 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.126828    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-token\") pod \"e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") " pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.180844 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.180617    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:40.185476 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.185450    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.185693 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.185678    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.185868 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.185855    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88h4\" (UniqueName: \"kubernetes.io/projected/4dfb08b1-180a-4100-8197-65c5431343f6-kube-api-access-d88h4\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.293200 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.293171    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.294113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.294090    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.294433 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.294417    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88h4\" (UniqueName: \"kubernetes.io/projected/4dfb08b1-180a-4100-8197-65c5431343f6-kube-api-access-d88h4\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.294795 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.294752    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.320972 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.320852    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.333278 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.333247    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88h4\" (UniqueName: \"kubernetes.io/projected/4dfb08b1-180a-4100-8197-65c5431343f6-kube-api-access-d88h4\") pod \"maas-api-revoke-sub-dace93a1-7hshs\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.340558 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.340532    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:10:40.364676 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.362827    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"]
Nov 03 06:10:40.373539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.373445    4418 generic.go:356] "Generic (PLEG): container finished" podID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerID="3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa" exitCode=0
Nov 03 06:10:40.373539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.373490    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"
Nov 03 06:10:40.373672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.373577    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" event={"ID":"ed72d1de-7983-4050-9374-6bcb80b898a6","Type":"ContainerDied","Data":"3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa"}
Nov 03 06:10:40.373672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.373622    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r" event={"ID":"ed72d1de-7983-4050-9374-6bcb80b898a6","Type":"ContainerDied","Data":"caca7d1960d2b5bc2bb136fe819a9ff00f555758ad4e4126d94baf7d953ee509"}
Nov 03 06:10:40.373672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.373645    4418 scope.go:122] "RemoveContainer" containerID="3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa"
Nov 03 06:10:40.373672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.373943    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.373672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.374016    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.373672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.374059    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.376975 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.376829    4418 generic.go:356] "Generic (PLEG): container finished" podID="8d005559-722f-4a24-ab66-6a8ff953670a" containerID="e729f2c0a6ee4e2262277d863b4e72a3485972c10abf8945374882c15fda7529" exitCode=0
Nov 03 06:10:40.376975 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.376939    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn" event={"ID":"8d005559-722f-4a24-ab66-6a8ff953670a","Type":"ContainerDied","Data":"e729f2c0a6ee4e2262277d863b4e72a3485972c10abf8945374882c15fda7529"}
Nov 03 06:10:40.379367 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.379344    4418 generic.go:356] "Generic (PLEG): container finished" podID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerID="33c9dab94f0dfaf51aa1ece6d8c164ee2a8d0bd5f3ead83d7244ae61a67ac680" exitCode=0
Nov 03 06:10:40.379555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.379534    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" event={"ID":"b8be923f-75fc-4db1-84f7-d5347bbfe58a","Type":"ContainerDied","Data":"33c9dab94f0dfaf51aa1ece6d8c164ee2a8d0bd5f3ead83d7244ae61a67ac680"}
Nov 03 06:10:40.386882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.386859    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:10:40.397156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.396865    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-dshm\") pod \"ed72d1de-7983-4050-9374-6bcb80b898a6\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") "
Nov 03 06:10:40.397156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.397000    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed72d1de-7983-4050-9374-6bcb80b898a6-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed72d1de-7983-4050-9374-6bcb80b898a6-tls-certs\") pod \"ed72d1de-7983-4050-9374-6bcb80b898a6\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") "
Nov 03 06:10:40.397156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.397041    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-model-cache\") pod \"ed72d1de-7983-4050-9374-6bcb80b898a6\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") "
Nov 03 06:10:40.397156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.397074    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-tmp-dir\") pod \"ed72d1de-7983-4050-9374-6bcb80b898a6\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") "
Nov 03 06:10:40.401470 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.397445    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-home\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-home\") pod \"ed72d1de-7983-4050-9374-6bcb80b898a6\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") "
Nov 03 06:10:40.401470 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.397541    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed72d1de-7983-4050-9374-6bcb80b898a6-kube-api-access-p69rs\" (UniqueName: \"kubernetes.io/projected/ed72d1de-7983-4050-9374-6bcb80b898a6-kube-api-access-p69rs\") pod \"ed72d1de-7983-4050-9374-6bcb80b898a6\" (UID: \"ed72d1de-7983-4050-9374-6bcb80b898a6\") "
Nov 03 06:10:40.402014 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.401987    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-home" pod "ed72d1de-7983-4050-9374-6bcb80b898a6" (UID: "ed72d1de-7983-4050-9374-6bcb80b898a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.402301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.402280    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-model-cache" pod "ed72d1de-7983-4050-9374-6bcb80b898a6" (UID: "ed72d1de-7983-4050-9374-6bcb80b898a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.402474 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.402449    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-tmp-dir" pod "ed72d1de-7983-4050-9374-6bcb80b898a6" (UID: "ed72d1de-7983-4050-9374-6bcb80b898a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.405672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.405647    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed72d1de-7983-4050-9374-6bcb80b898a6-kube-api-access-p69rs" pod "ed72d1de-7983-4050-9374-6bcb80b898a6" (UID: "ed72d1de-7983-4050-9374-6bcb80b898a6"). InnerVolumeSpecName "kube-api-access-p69rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:40.407769 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.407659    4418 scope.go:122] "RemoveContainer" containerID="3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa"
Nov 03 06:10:40.407991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.407964    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed72d1de-7983-4050-9374-6bcb80b898a6-tls-certs" pod "ed72d1de-7983-4050-9374-6bcb80b898a6" (UID: "ed72d1de-7983-4050-9374-6bcb80b898a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:40.408392 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:40.408327    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa\": container with ID starting with 3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa not found: ID does not exist" containerID="3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa"
Nov 03 06:10:40.408392 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.408364    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa"} err="failed to get container status \"3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa\": rpc error: code = NotFound desc = could not find container \"3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa\": container with ID starting with 3db97d722303c16f3c8973c1f619d768ed14a878fc702518680389b503558bfa not found: ID does not exist"
Nov 03 06:10:40.412330 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.410904    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-dshm" pod "ed72d1de-7983-4050-9374-6bcb80b898a6" (UID: "ed72d1de-7983-4050-9374-6bcb80b898a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.463603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.462137    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.463603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.462221    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.463603 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.462267    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.464548 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.464524    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"]
Nov 03 06:10:40.491227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.491010    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:40.498937 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.498896    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tls-certs\" (UniqueName: \"kubernetes.io/secret/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tls-certs\") pod \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") "
Nov 03 06:10:40.499044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.498992    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8be923f-75fc-4db1-84f7-d5347bbfe58a-kube-api-access-gqs7r\" (UniqueName: \"kubernetes.io/projected/b8be923f-75fc-4db1-84f7-d5347bbfe58a-kube-api-access-gqs7r\") pod \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") "
Nov 03 06:10:40.499124 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.499041    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-home\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-home\") pod \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") "
Nov 03 06:10:40.499124 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.499071    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-model-cache\") pod \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") "
Nov 03 06:10:40.499244 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.499125    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tmp-dir\") pod \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") "
Nov 03 06:10:40.499315 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.499245    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-dshm\") pod \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\" (UID: \"b8be923f-75fc-4db1-84f7-d5347bbfe58a\") "
Nov 03 06:10:40.500162 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.500139    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed72d1de-7983-4050-9374-6bcb80b898a6-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.500429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.500169    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.500429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.500185    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.500429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.500197    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.500429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.500210    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p69rs\" (UniqueName: \"kubernetes.io/projected/ed72d1de-7983-4050-9374-6bcb80b898a6-kube-api-access-p69rs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.500429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.500226    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed72d1de-7983-4050-9374-6bcb80b898a6-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.503631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.503357    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-home" pod "b8be923f-75fc-4db1-84f7-d5347bbfe58a" (UID: "b8be923f-75fc-4db1-84f7-d5347bbfe58a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.503811 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.503788    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tmp-dir" pod "b8be923f-75fc-4db1-84f7-d5347bbfe58a" (UID: "b8be923f-75fc-4db1-84f7-d5347bbfe58a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.506025 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.505939    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8be923f-75fc-4db1-84f7-d5347bbfe58a-kube-api-access-gqs7r" pod "b8be923f-75fc-4db1-84f7-d5347bbfe58a" (UID: "b8be923f-75fc-4db1-84f7-d5347bbfe58a"). InnerVolumeSpecName "kube-api-access-gqs7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:40.508008 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.507983    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-model-cache" pod "b8be923f-75fc-4db1-84f7-d5347bbfe58a" (UID: "b8be923f-75fc-4db1-84f7-d5347bbfe58a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.508700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.508666    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-dshm" pod "b8be923f-75fc-4db1-84f7-d5347bbfe58a" (UID: "b8be923f-75fc-4db1-84f7-d5347bbfe58a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:40.510240 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.510054    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tls-certs" pod "b8be923f-75fc-4db1-84f7-d5347bbfe58a" (UID: "b8be923f-75fc-4db1-84f7-d5347bbfe58a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:40.537273 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.536402    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"]
Nov 03 06:10:40.540864 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:40.540823    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295cd236_273a_41d4_b1ce_be6d1690a33c.slice/crio-ebd1b719e4934482d5d65294cf46c9d890992ad4b6a40df77b15cb72f7362189 WatchSource:0}: Error finding container ebd1b719e4934482d5d65294cf46c9d890992ad4b6a40df77b15cb72f7362189: Status 404 returned error can't find the container with id ebd1b719e4934482d5d65294cf46c9d890992ad4b6a40df77b15cb72f7362189
Nov 03 06:10:40.544453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.543334    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.544453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.543411    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.544453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.543455    4418 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 03 06:10:40.601798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.601671    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.601798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.601696    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.601798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.601707    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqs7r\" (UniqueName: \"kubernetes.io/projected/b8be923f-75fc-4db1-84f7-d5347bbfe58a-kube-api-access-gqs7r\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.601798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.601716    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.601798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.601724    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.601798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.601733    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8be923f-75fc-4db1-84f7-d5347bbfe58a-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:40.746600 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.744208    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"]
Nov 03 06:10:40.749967 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.749938    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/distinct-2-w6-86728b-kserve-7445bc9ffc-mhk4r"]
Nov 03 06:10:40.822920 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.822825    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:40.824396 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.823246    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29455561-7928-4756-a42c-8c2871ab2d80" path="/var/lib/kubelet/pods/29455561-7928-4756-a42c-8c2871ab2d80/volumes"
Nov 03 06:10:40.824396 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.823939    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" path="/var/lib/kubelet/pods/ed72d1de-7983-4050-9374-6bcb80b898a6/volumes"
Nov 03 06:10:40.925601 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:40.925570    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"]
Nov 03 06:10:40.927425 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:40.927398    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dfb08b1_180a_4100_8197_65c5431343f6.slice/crio-29fd6fc62b6a4b6c2c512a8269ba5c02e962e1a1a6df3f132068835fb3622170 WatchSource:0}: Error finding container 29fd6fc62b6a4b6c2c512a8269ba5c02e962e1a1a6df3f132068835fb3622170: Status 404 returned error can't find the container with id 29fd6fc62b6a4b6c2c512a8269ba5c02e962e1a1a6df3f132068835fb3622170
Nov 03 06:10:41.048950 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.048860    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"]
Nov 03 06:10:41.208929 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.208901    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:41.387939 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.387905    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" event={"ID":"84e6cf40-6ada-41c2-b797-c62c74c1c862","Type":"ContainerStarted","Data":"3ea50a79779d8ef81e497ddf4d83d5634ba88be792ab49b0da381c6b0fce69f6"}
Nov 03 06:10:41.388100 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.387963    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" event={"ID":"84e6cf40-6ada-41c2-b797-c62c74c1c862","Type":"ContainerStarted","Data":"a72b32fdea14eefb7b012f3233d06c242415fa54a4ffed1bbcadbfcf96fa295b"}
Nov 03 06:10:41.390848 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.390824    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" event={"ID":"be0a6235-7bfe-408f-a725-3e17537ea9ab","Type":"ContainerStarted","Data":"aed968c956570f6d9af02be17053ec2e8e72c9ecbed804941635799f5c5af477"}
Nov 03 06:10:41.390970 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.390867    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" event={"ID":"be0a6235-7bfe-408f-a725-3e17537ea9ab","Type":"ContainerStarted","Data":"db5d10bdcc2bbf95bb960bfd2fb5b263af771d57d4479481142685c3468e044e"}
Nov 03 06:10:41.392365 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.392338    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs" event={"ID":"4dfb08b1-180a-4100-8197-65c5431343f6","Type":"ContainerStarted","Data":"7f2f85166d542204f412676e670bed237bde6eee3ea368626db17f19cc9b4a25"}
Nov 03 06:10:41.392464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.392381    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs" event={"ID":"4dfb08b1-180a-4100-8197-65c5431343f6","Type":"ContainerStarted","Data":"29fd6fc62b6a4b6c2c512a8269ba5c02e962e1a1a6df3f132068835fb3622170"}
Nov 03 06:10:41.393684 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.393666    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"
Nov 03 06:10:41.393756 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.393690    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9" event={"ID":"b8be923f-75fc-4db1-84f7-d5347bbfe58a","Type":"ContainerDied","Data":"fe87235bdb8285b5492a878c1ffb1836e968bfd24b680f48076881e6cbdb986f"}
Nov 03 06:10:41.393756 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.393732    4418 scope.go:122] "RemoveContainer" containerID="33c9dab94f0dfaf51aa1ece6d8c164ee2a8d0bd5f3ead83d7244ae61a67ac680"
Nov 03 06:10:41.395597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.395474    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" event={"ID":"295cd236-273a-41d4-b1ce-be6d1690a33c","Type":"ContainerStarted","Data":"cb2581ebc900c9529d3bee32e211bff98e78500d1dc66eded6f3b21d436f2e85"}
Nov 03 06:10:41.395597 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.395534    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" event={"ID":"295cd236-273a-41d4-b1ce-be6d1690a33c","Type":"ContainerStarted","Data":"ebd1b719e4934482d5d65294cf46c9d890992ad4b6a40df77b15cb72f7362189"}
Nov 03 06:10:41.451712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.451657    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podStartSLOduration=2.451638184 podStartE2EDuration="2.451638184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:10:41.449553383 +0000 UTC m=+928.819503468" watchObservedRunningTime="2026-11-03 06:10:41.451638184 +0000 UTC m=+928.821588268"
Nov 03 06:10:41.494639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.494578    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs" podStartSLOduration=1.494559523 podStartE2EDuration="1.494559523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:10:41.49210871 +0000 UTC m=+928.862058796" watchObservedRunningTime="2026-11-03 06:10:41.494559523 +0000 UTC m=+928.864509607"
Nov 03 06:10:41.532860 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.532828    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"]
Nov 03 06:10:41.539655 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.539631    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-86728b/premium-w6-86728b-kserve-77dd4f4499-898g9"]
Nov 03 06:10:41.570882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.570860    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:41.598602 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.598551    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podStartSLOduration=2.5985382059999997 podStartE2EDuration="2.598538206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:10:41.596987818 +0000 UTC m=+928.966937932" watchObservedRunningTime="2026-11-03 06:10:41.598538206 +0000 UTC m=+928.968488290"
Nov 03 06:10:41.661661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.656126    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-openshift-ca\") pod \"8d005559-722f-4a24-ab66-6a8ff953670a\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") "
Nov 03 06:10:41.661661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.658204    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-xks-ca\") pod \"8d005559-722f-4a24-ab66-6a8ff953670a\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") "
Nov 03 06:10:41.661661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.658281    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d005559-722f-4a24-ab66-6a8ff953670a-kube-api-access-5k47b\" (UniqueName: \"kubernetes.io/projected/8d005559-722f-4a24-ab66-6a8ff953670a-kube-api-access-5k47b\") pod \"8d005559-722f-4a24-ab66-6a8ff953670a\" (UID: \"8d005559-722f-4a24-ab66-6a8ff953670a\") "
Nov 03 06:10:41.661661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.660465    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-openshift-ca" pod "8d005559-722f-4a24-ab66-6a8ff953670a" (UID: "8d005559-722f-4a24-ab66-6a8ff953670a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:41.662528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.662455    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d005559-722f-4a24-ab66-6a8ff953670a-kube-api-access-5k47b" pod "8d005559-722f-4a24-ab66-6a8ff953670a" (UID: "8d005559-722f-4a24-ab66-6a8ff953670a"). InnerVolumeSpecName "kube-api-access-5k47b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:41.663846 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.663785    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podStartSLOduration=2.663765915 podStartE2EDuration="2.663765915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:10:41.660837689 +0000 UTC m=+929.030787774" watchObservedRunningTime="2026-11-03 06:10:41.663765915 +0000 UTC m=+929.033715999"
Nov 03 06:10:41.669201 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.669151    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-xks-ca" pod "8d005559-722f-4a24-ab66-6a8ff953670a" (UID: "8d005559-722f-4a24-ab66-6a8ff953670a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:41.762739 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.762698    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-openshift-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:41.762739 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.762738    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d005559-722f-4a24-ab66-6a8ff953670a-maas-api-xks-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:41.763007 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:41.762755    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k47b\" (UniqueName: \"kubernetes.io/projected/8d005559-722f-4a24-ab66-6a8ff953670a-kube-api-access-5k47b\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:42.012579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.009564    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:42.013939 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.013609    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 06:10:42.013939 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.013668    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 06:10:42.125523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.113972    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:42.125523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.115892    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 06:10:42.125523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.115947    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 06:10:42.194526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.187320    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:42.194526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.187470    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Nov 03 06:10:42.194526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.187778    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Nov 03 06:10:42.360966 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.360656    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" podUID="538fb4be-1740-4814-b31e-ca5fdc22b819" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 06:10:42.470308 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.470218    4418 generic.go:356] "Generic (PLEG): container finished" podID="4dfb08b1-180a-4100-8197-65c5431343f6" containerID="7f2f85166d542204f412676e670bed237bde6eee3ea368626db17f19cc9b4a25" exitCode=0
Nov 03 06:10:42.470674 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.470303    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs" event={"ID":"4dfb08b1-180a-4100-8197-65c5431343f6","Type":"ContainerDied","Data":"7f2f85166d542204f412676e670bed237bde6eee3ea368626db17f19cc9b4a25"}
Nov 03 06:10:42.480175 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.480145    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"
Nov 03 06:10:42.503593 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.503557    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn" event={"ID":"8d005559-722f-4a24-ab66-6a8ff953670a","Type":"ContainerDied","Data":"1e669fc907de2d6f5b6ebdcf52f0ca380899b57677d30ae359c20eb1e193abea"}
Nov 03 06:10:42.503823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.503807    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e669fc907de2d6f5b6ebdcf52f0ca380899b57677d30ae359c20eb1e193abea"
Nov 03 06:10:42.860051 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:42.860009    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" path="/var/lib/kubelet/pods/b8be923f-75fc-4db1-84f7-d5347bbfe58a/volumes"
Nov 03 06:10:43.015526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:43.014603    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 06:10:43.015526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:43.014672    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 06:10:43.089527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:43.086901    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:43.109794 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:43.109764    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 06:10:43.110143 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:43.110075    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 06:10:43.186839 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:43.186805    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Nov 03 06:10:43.187091 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:43.187066    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Nov 03 06:10:44.026722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.018632    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 06:10:44.026722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.018692    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 06:10:44.064425 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.064400    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:44.124158 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.106117    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dfb08b1-180a-4100-8197-65c5431343f6-kube-api-access-d88h4\" (UniqueName: \"kubernetes.io/projected/4dfb08b1-180a-4100-8197-65c5431343f6-kube-api-access-d88h4\") pod \"4dfb08b1-180a-4100-8197-65c5431343f6\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") "
Nov 03 06:10:44.124158 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.106240    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-xks-ca\") pod \"4dfb08b1-180a-4100-8197-65c5431343f6\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") "
Nov 03 06:10:44.124158 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.106356    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-openshift-ca\") pod \"4dfb08b1-180a-4100-8197-65c5431343f6\" (UID: \"4dfb08b1-180a-4100-8197-65c5431343f6\") "
Nov 03 06:10:44.146241 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.146202    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 06:10:44.146548 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.146488    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 06:10:44.163751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.157721    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-openshift-ca" pod "4dfb08b1-180a-4100-8197-65c5431343f6" (UID: "4dfb08b1-180a-4100-8197-65c5431343f6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:44.163751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.161229    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-xks-ca" pod "4dfb08b1-180a-4100-8197-65c5431343f6" (UID: "4dfb08b1-180a-4100-8197-65c5431343f6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:44.166664 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.166577    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dfb08b1-180a-4100-8197-65c5431343f6-kube-api-access-d88h4" pod "4dfb08b1-180a-4100-8197-65c5431343f6" (UID: "4dfb08b1-180a-4100-8197-65c5431343f6"). InnerVolumeSpecName "kube-api-access-d88h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:44.207757 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.181863    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Nov 03 06:10:44.207757 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.181912    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Nov 03 06:10:44.239645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.218877    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-openshift-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:44.239645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.218912    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d88h4\" (UniqueName: \"kubernetes.io/projected/4dfb08b1-180a-4100-8197-65c5431343f6-kube-api-access-d88h4\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:44.239645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.218929    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dfb08b1-180a-4100-8197-65c5431343f6-maas-api-xks-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:44.364178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.364138    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" podUID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 06:10:44.558332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.558228    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs" event={"ID":"4dfb08b1-180a-4100-8197-65c5431343f6","Type":"ContainerDied","Data":"29fd6fc62b6a4b6c2c512a8269ba5c02e962e1a1a6df3f132068835fb3622170"}
Nov 03 06:10:44.558332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.558313    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29fd6fc62b6a4b6c2c512a8269ba5c02e962e1a1a6df3f132068835fb3622170"
Nov 03 06:10:44.558332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:44.558337    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"
Nov 03 06:10:45.011529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.010898    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 06:10:45.011529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.010979    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 06:10:45.109990 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.109949    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 06:10:45.110623 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.110589    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 06:10:45.190100 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.190067    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Nov 03 06:10:45.190369 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.190344    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Nov 03 06:10:45.370522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.369262    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:45.579525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:45.578903    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:46.031535 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.005878    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 06:10:46.031535 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.005951    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 06:10:46.079779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.059534    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:46.079779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.059632    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"]
Nov 03 06:10:46.079779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.059851    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" containerID="cri-o://832e5c4c3745142d92e6f23b7776c7b35dae3c3e36292dd5454630cdb9a33895" gracePeriod=30
Nov 03 06:10:46.150539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.122634    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 06:10:46.150539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.122716    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 06:10:46.201972 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.201933    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Nov 03 06:10:46.210444 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.210405    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Nov 03 06:10:46.246205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.245620    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"]
Nov 03 06:10:46.246205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.245859    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" containerID="cri-o://abaa9fd41a1ec075c2280021bbb40a01e0ead950c98763cad7d87aeb2a2123ee" gracePeriod=30
Nov 03 06:10:46.321713 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.321586    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"]
Nov 03 06:10:46.338534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:46.332738    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" containerID="cri-o://17098fc956ce01c689799e4cfba63a8934d66d02c352c138f1ce87693f3db301" gracePeriod=30
Nov 03 06:10:47.008563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.008526    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 06:10:47.008848 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.008821    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 06:10:47.115606 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.115573    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 06:10:47.115893 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.115861    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 06:10:47.188531 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.185726    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Nov 03 06:10:47.189109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.189071    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Nov 03 06:10:47.315095 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.314948    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:47.559350 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.559203    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:47.906044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.905671    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:10:47.906044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:47.905734    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:10:48.017387 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.002992    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 06:10:48.017387 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.003068    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 06:10:48.115231 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.115197    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 06:10:48.115558 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.115526    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 06:10:48.183051 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.182961    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Nov 03 06:10:48.184571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.184538    4418 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Nov 03 06:10:48.559859 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.559766    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:48.737554 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:48.737522    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:49.415655 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.415479    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Nov 03 06:10:49.415655 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.415558    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:10:49.431690 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.429800    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:49.433100 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.432313    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:49.434465 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.434415    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:10:49.485107 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.485073    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:49.485540 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.485477    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:49.487041 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.487018    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:10:49.649134 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.649095    4418 patch_prober.go:29] interesting pod/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:10:49.649648 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.649158    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:10:49.679935 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.679838    4418 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:49.680383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.680353    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:49.681293 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:49.681269    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:10:50.832526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:50.828064    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:51.820787 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:51.820519    4418 generic.go:356] "Generic (PLEG): container finished" podID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerID="832e5c4c3745142d92e6f23b7776c7b35dae3c3e36292dd5454630cdb9a33895" exitCode=0
Nov 03 06:10:51.820787 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:51.820700    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" event={"ID":"84bf9f7a-e132-446b-a527-a69f8885aceb","Type":"ContainerDied","Data":"832e5c4c3745142d92e6f23b7776c7b35dae3c3e36292dd5454630cdb9a33895"}
Nov 03 06:10:51.825054 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:51.824121    4418 generic.go:356] "Generic (PLEG): container finished" podID="29019981-1664-4c52-bc0a-784c8061b931" containerID="abaa9fd41a1ec075c2280021bbb40a01e0ead950c98763cad7d87aeb2a2123ee" exitCode=0
Nov 03 06:10:51.825863 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:51.825793    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" event={"ID":"29019981-1664-4c52-bc0a-784c8061b931","Type":"ContainerDied","Data":"abaa9fd41a1ec075c2280021bbb40a01e0ead950c98763cad7d87aeb2a2123ee"}
Nov 03 06:10:52.254523 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.248556    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"]
Nov 03 06:10:52.268474 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.268438    4418 cpu_manager.go:414] "containerMap: removing container" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main"
Nov 03 06:10:52.276604 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.276572    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main"
Nov 03 06:10:52.276804 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.276790    4418 cpu_manager.go:414] "containerMap: removing container" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main"
Nov 03 06:10:52.276895 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.276883    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main"
Nov 03 06:10:52.277003 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.276992    4418 cpu_manager.go:414] "containerMap: removing container" podUID="4dfb08b1-180a-4100-8197-65c5431343f6" containerName="revoke-keys"
Nov 03 06:10:52.277100 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.277088    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dfb08b1-180a-4100-8197-65c5431343f6" containerName="revoke-keys"
Nov 03 06:10:52.290626 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.290596    4418 cpu_manager.go:414] "containerMap: removing container" podUID="8d005559-722f-4a24-ab66-6a8ff953670a" containerName="revoke-keys"
Nov 03 06:10:52.290789 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.290775    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d005559-722f-4a24-ab66-6a8ff953670a" containerName="revoke-keys"
Nov 03 06:10:52.291052 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.291037    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8be923f-75fc-4db1-84f7-d5347bbfe58a" containerName="main"
Nov 03 06:10:52.291156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.291146    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed72d1de-7983-4050-9374-6bcb80b898a6" containerName="main"
Nov 03 06:10:52.291260 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.291250    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dfb08b1-180a-4100-8197-65c5431343f6" containerName="revoke-keys"
Nov 03 06:10:52.291363 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.291352    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d005559-722f-4a24-ab66-6a8ff953670a" containerName="revoke-keys"
Nov 03 06:10:52.639525 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.637656    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" podUID="538fb4be-1740-4814-b31e-ca5fdc22b819" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 06:10:52.768232 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.768196    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"]
Nov 03 06:10:52.789669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.781849    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:52.840461 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.833468    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 06:10:52.849247 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.849215    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rxh5n\""
Nov 03 06:10:53.000583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.872273    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr69v\" (UniqueName: \"kubernetes.io/projected/15ae3cf1-f453-4368-8843-fec7d202cdbe-kube-api-access-kr69v\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.000583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.985601    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.246761 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:52.985804    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.326534 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.324771    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:53.401527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.399839    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:53.401527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.399713    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:53.464544 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.461325    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:53.488539 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.475799    4418 generic.go:356] "Generic (PLEG): container finished" podID="66151bde-baff-4252-849b-9a70cdcb4aec" containerID="17098fc956ce01c689799e4cfba63a8934d66d02c352c138f1ce87693f3db301" exitCode=0
Nov 03 06:10:53.512569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.509536    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" event={"ID":"66151bde-baff-4252-849b-9a70cdcb4aec","Type":"ContainerDied","Data":"17098fc956ce01c689799e4cfba63a8934d66d02c352c138f1ce87693f3db301"}
Nov 03 06:10:53.515874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.513996    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr69v\" (UniqueName: \"kubernetes.io/projected/15ae3cf1-f453-4368-8843-fec7d202cdbe-kube-api-access-kr69v\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.515874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.514147    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.515874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.514294    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.515874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.515135    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.680109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.680033    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.771133 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.771053    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:10:53.830645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.817731    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr69v\" (UniqueName: \"kubernetes.io/projected/15ae3cf1-f453-4368-8843-fec7d202cdbe-kube-api-access-kr69v\") pod \"maas-api-revoke-sub-42cb49ea-gchds\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:53.890753 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.890715    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:10:53.891479 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.891449    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.891679 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.891659    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.891836 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.891821    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-certs\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.891995 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.891978    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-socket\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.892255 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.892235    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-credential-socket\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.915962 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.915935    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29019981-1664-4c52-bc0a-784c8061b931-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29019981-1664-4c52-bc0a-784c8061b931-istiod-ca-cert\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.916224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.916210    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.916325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.916313    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-data\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.916426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.916414    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:53.923931 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.914597    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-certs" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:53.924142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.914806    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-socket" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:53.924230 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.915796    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-credential-socket" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:53.924302 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.923891    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29019981-1664-4c52-bc0a-784c8061b931-istiod-ca-cert" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:53.931884 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.931845    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-data" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:53.938573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:53.932142    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" probeResult="failure" output="Get \"https://10.134.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:54.037044 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.036949    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-socket\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.185628 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.045703    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-socket" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:54.185823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.133241    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "kube-api-access-jt6hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:54.185938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.179629    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:10:54.186017 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.133596    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:54.199706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.199668    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:54.200088 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.200062    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:54.200576 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.200557    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-kube-api-access-plnvc\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-kube-api-access-plnvc\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.200811 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.200793    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-data\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.204683 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.204663    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-envoy\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.205166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.205147    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-podinfo\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.223014 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.222984    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:54.230528 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.223304    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-certs\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.295674 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.295586    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:54.296016 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.295994    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:54.296145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.296127    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\") pod \"29019981-1664-4c52-bc0a-784c8061b931\" (UID: \"29019981-1664-4c52-bc0a-784c8061b931\") "
Nov 03 06:10:54.296271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.296256    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84bf9f7a-e132-446b-a527-a69f8885aceb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bf9f7a-e132-446b-a527-a69f8885aceb-istiod-ca-cert\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.296400 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.296386    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-credential-socket\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.296563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.296545    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-token\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-token\") pod \"84bf9f7a-e132-446b-a527-a69f8885aceb\" (UID: \"84bf9f7a-e132-446b-a527-a69f8885aceb\") "
Nov 03 06:10:54.327395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.327360    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.345694 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.345663    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29019981-1664-4c52-bc0a-784c8061b931-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.345921 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.345905    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.351632 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.351603    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.352026 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.351833    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.355570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.355543    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.447570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.204597    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-data" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:54.447570 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:54.230781    4418 empty_dir.go:505] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/29019981-1664-4c52-bc0a-784c8061b931/volumes/kubernetes.io~projected/istio-token
Nov 03 06:10:54.447570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.419852    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:54.447570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.435157    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:10:54.461790 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.461742    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:10:54.464761 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.463924    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:10:54.477570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.233611    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-certs" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:54.477744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.335328    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84bf9f7a-e132-446b-a527-a69f8885aceb-istiod-ca-cert" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:54.477836 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:54.335403    4418 empty_dir.go:505] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/29019981-1664-4c52-bc0a-784c8061b931/volumes/kubernetes.io~projected/kube-api-access-jt6hp
Nov 03 06:10:54.477911 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:54.345571    4418 empty_dir.go:505] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/29019981-1664-4c52-bc0a-784c8061b931/volumes/kubernetes.io~downward-api/istio-podinfo
Nov 03 06:10:54.478006 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.477986    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:10:54.478086 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:10:54.345625    4418 empty_dir.go:505] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/29019981-1664-4c52-bc0a-784c8061b931/volumes/kubernetes.io~empty-dir/istio-envoy
Nov 03 06:10:54.478171 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.478156    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:54.478259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.355604    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-credential-socket" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:54.492442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.492416    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:10:54.500521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.499286    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:54.500521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.499450    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp" pod "29019981-1664-4c52-bc0a-784c8061b931" (UID: "29019981-1664-4c52-bc0a-784c8061b931"). InnerVolumeSpecName "kube-api-access-jt6hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:54.529879 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.529838    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.531514 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.531478    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.531691 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.531675    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.531801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.531789    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29019981-1664-4c52-bc0a-784c8061b931-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.531891 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.531880    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29019981-1664-4c52-bc0a-784c8061b931-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.531978 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.531964    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt6hp\" (UniqueName: \"kubernetes.io/projected/29019981-1664-4c52-bc0a-784c8061b931-kube-api-access-jt6hp\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.532077 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.532064    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84bf9f7a-e132-446b-a527-a69f8885aceb-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.532169 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.532158    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.542530 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.542351    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-envoy" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:54.635530 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.632673    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" podUID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 06:10:54.635530 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.634183    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:54.902593 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.899981    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-token" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:54.904190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.904160    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-kube-api-access-plnvc" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "kube-api-access-plnvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:54.951736 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:54.951057    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-podinfo" pod "84bf9f7a-e132-446b-a527-a69f8885aceb" (UID: "84bf9f7a-e132-446b-a527-a69f8885aceb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:10:55.003880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.003847    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"
Nov 03 06:10:55.013737 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.013708    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:10:55.026956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.026807    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.027161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.027144    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plnvc\" (UniqueName: \"kubernetes.io/projected/84bf9f7a-e132-446b-a527-a69f8885aceb-kube-api-access-plnvc\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.027295 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.027283    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84bf9f7a-e132-446b-a527-a69f8885aceb-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.035301 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.035271    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n" event={"ID":"84bf9f7a-e132-446b-a527-a69f8885aceb","Type":"ContainerDied","Data":"16629bd916d24750242844a386e6a09d2aa8f4fc2385687bc620cb9d16fa9489"}
Nov 03 06:10:55.035542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.035527    4418 scope.go:122] "RemoveContainer" containerID="832e5c4c3745142d92e6f23b7776c7b35dae3c3e36292dd5454630cdb9a33895"
Nov 03 06:10:55.068711 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.068670    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"
Nov 03 06:10:55.121936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.119836    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx" event={"ID":"29019981-1664-4c52-bc0a-784c8061b931","Type":"ContainerDied","Data":"de2df0d98290ec015b8cc2b1e7f4b030169797093cafbfe958e39540e39af7b6"}
Nov 03 06:10:55.121936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.119951    4418 scope.go:122] "RemoveContainer" containerID="abaa9fd41a1ec075c2280021bbb40a01e0ead950c98763cad7d87aeb2a2123ee"
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.132612    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/66151bde-baff-4252-849b-9a70cdcb4aec-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66151bde-baff-4252-849b-9a70cdcb4aec-istio-podinfo\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.132702    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66151bde-baff-4252-849b-9a70cdcb4aec-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66151bde-baff-4252-849b-9a70cdcb4aec-istiod-ca-cert\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.132770    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-istio-token\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-istio-token\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.132856    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-certs\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.132912    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-credential-socket\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.132960    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-kube-api-access-ptxw4\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-kube-api-access-ptxw4\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.133057    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-envoy\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.133156    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-socket\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.133289    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-data\") pod \"66151bde-baff-4252-849b-9a70cdcb4aec\" (UID: \"66151bde-baff-4252-849b-9a70cdcb4aec\") "
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.138712    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66151bde-baff-4252-849b-9a70cdcb4aec-istiod-ca-cert" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:55.141090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.138630    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-certs" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:55.158643 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.158609    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-data" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:55.187923 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.180179    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-socket" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:55.188488 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.188457    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:55.225730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.209741    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-credential-socket" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:55.225730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.217681    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-kube-api-access-ptxw4" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "kube-api-access-ptxw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:55.268527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.254041    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.268527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.254077    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.268527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.254094    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptxw4\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-kube-api-access-ptxw4\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.268527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.254118    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.268527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.254136    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.268527 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.254154    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66151bde-baff-4252-849b-9a70cdcb4aec-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.428589 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.427978    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"]
Nov 03 06:10:55.480535 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.475114    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-istio-token" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:55.480535 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.475212    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66151bde-baff-4252-849b-9a70cdcb4aec-istio-podinfo" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:10:55.568793 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.566227    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": context deadline exceeded"
Nov 03 06:10:55.579416 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.570834    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-xmq2n"]
Nov 03 06:10:55.579416 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.574295    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66151bde-baff-4252-849b-9a70cdcb4aec-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.579416 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.574318    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66151bde-baff-4252-849b-9a70cdcb4aec-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.595297 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.595211    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"]
Nov 03 06:10:55.595553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.595537    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-gqtwx"]
Nov 03 06:10:55.606350 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.603025    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-envoy" pod "66151bde-baff-4252-849b-9a70cdcb4aec" (UID: "66151bde-baff-4252-849b-9a70cdcb4aec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:55.623055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.617790    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:10:55.677165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.676540    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66151bde-baff-4252-849b-9a70cdcb4aec-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:55.866944 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.865952    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"]
Nov 03 06:10:55.912878 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:55.912712    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:56.093889 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.093822    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main" containerID="cri-o://28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5" gracePeriod=45
Nov 03 06:10:56.101079 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.101050    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn" event={"ID":"66151bde-baff-4252-849b-9a70cdcb4aec","Type":"ContainerDied","Data":"0b79560fd7ad2eb2a0c80b1517246b7397aa4a2deef993b6959a077405aa6ff5"}
Nov 03 06:10:56.101345 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.101327    4418 scope.go:122] "RemoveContainer" containerID="17098fc956ce01c689799e4cfba63a8934d66d02c352c138f1ce87693f3db301"
Nov 03 06:10:56.107950 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.107929    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"
Nov 03 06:10:56.110725 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.110690    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds" event={"ID":"15ae3cf1-f453-4368-8843-fec7d202cdbe","Type":"ContainerStarted","Data":"ce70a6e42a3eb68d9ea8714e09142ee0ada9776fa47a81af660df3941be0e7ec"}
Nov 03 06:10:56.342079 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.339375    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"]
Nov 03 06:10:56.363476 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.361742    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-ba6892-openshift-default-8548d7cc5f-m62zn"]
Nov 03 06:10:56.467207 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.467182    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:10:56.497404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.497364    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/538fb4be-1740-4814-b31e-ca5fdc22b819-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/538fb4be-1740-4814-b31e-ca5fdc22b819-plugins-config-volume\") pod \"538fb4be-1740-4814-b31e-ca5fdc22b819\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") "
Nov 03 06:10:56.497683 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.497569    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/538fb4be-1740-4814-b31e-ca5fdc22b819-kube-api-access-8qkst\" (UniqueName: \"kubernetes.io/projected/538fb4be-1740-4814-b31e-ca5fdc22b819-kube-api-access-8qkst\") pod \"538fb4be-1740-4814-b31e-ca5fdc22b819\" (UID: \"538fb4be-1740-4814-b31e-ca5fdc22b819\") "
Nov 03 06:10:56.498144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.498117    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/538fb4be-1740-4814-b31e-ca5fdc22b819-plugins-config-volume" pod "538fb4be-1740-4814-b31e-ca5fdc22b819" (UID: "538fb4be-1740-4814-b31e-ca5fdc22b819"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:56.499916 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.499829    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:10:56.501038 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.501012    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/538fb4be-1740-4814-b31e-ca5fdc22b819-kube-api-access-8qkst" pod "538fb4be-1740-4814-b31e-ca5fdc22b819" (UID: "538fb4be-1740-4814-b31e-ca5fdc22b819"). InnerVolumeSpecName "kube-api-access-8qkst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:56.599615 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.599572    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/776dbac9-7c0a-47b2-a2b4-eaf723467109-tls-certs\" (UniqueName: \"kubernetes.io/secret/776dbac9-7c0a-47b2-a2b4-eaf723467109-tls-certs\") pod \"776dbac9-7c0a-47b2-a2b4-eaf723467109\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") "
Nov 03 06:10:56.599816 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.599656    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-dshm\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-dshm\") pod \"776dbac9-7c0a-47b2-a2b4-eaf723467109\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") "
Nov 03 06:10:56.599816 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.599716    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-tmp-dir\") pod \"776dbac9-7c0a-47b2-a2b4-eaf723467109\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") "
Nov 03 06:10:56.599816 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.599750    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/776dbac9-7c0a-47b2-a2b4-eaf723467109-kube-api-access-2fdc9\" (UniqueName: \"kubernetes.io/projected/776dbac9-7c0a-47b2-a2b4-eaf723467109-kube-api-access-2fdc9\") pod \"776dbac9-7c0a-47b2-a2b4-eaf723467109\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") "
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.599823    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-model-cache\") pod \"776dbac9-7c0a-47b2-a2b4-eaf723467109\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") "
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.599878    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-home\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-home\") pod \"776dbac9-7c0a-47b2-a2b4-eaf723467109\" (UID: \"776dbac9-7c0a-47b2-a2b4-eaf723467109\") "
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.599981    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-tmp-dir" pod "776dbac9-7c0a-47b2-a2b4-eaf723467109" (UID: "776dbac9-7c0a-47b2-a2b4-eaf723467109"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.600232    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-home" pod "776dbac9-7c0a-47b2-a2b4-eaf723467109" (UID: "776dbac9-7c0a-47b2-a2b4-eaf723467109"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.600429    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-model-cache" pod "776dbac9-7c0a-47b2-a2b4-eaf723467109" (UID: "776dbac9-7c0a-47b2-a2b4-eaf723467109"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.600639    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.600662    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.600675    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.600690    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qkst\" (UniqueName: \"kubernetes.io/projected/538fb4be-1740-4814-b31e-ca5fdc22b819-kube-api-access-8qkst\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.600965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.600705    4418 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/538fb4be-1740-4814-b31e-ca5fdc22b819-plugins-config-volume\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.602393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.602366    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776dbac9-7c0a-47b2-a2b4-eaf723467109-kube-api-access-2fdc9" pod "776dbac9-7c0a-47b2-a2b4-eaf723467109" (UID: "776dbac9-7c0a-47b2-a2b4-eaf723467109"). InnerVolumeSpecName "kube-api-access-2fdc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:56.602681 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.602662    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-dshm" pod "776dbac9-7c0a-47b2-a2b4-eaf723467109" (UID: "776dbac9-7c0a-47b2-a2b4-eaf723467109"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:10:56.603786 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.603755    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/776dbac9-7c0a-47b2-a2b4-eaf723467109-tls-certs" pod "776dbac9-7c0a-47b2-a2b4-eaf723467109" (UID: "776dbac9-7c0a-47b2-a2b4-eaf723467109"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:56.702375 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.702299    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/776dbac9-7c0a-47b2-a2b4-eaf723467109-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.702375 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.702330    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/776dbac9-7c0a-47b2-a2b4-eaf723467109-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.702375 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.702339    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fdc9\" (UniqueName: \"kubernetes.io/projected/776dbac9-7c0a-47b2-a2b4-eaf723467109-kube-api-access-2fdc9\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:56.785570 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.785534    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29019981-1664-4c52-bc0a-784c8061b931" path="/var/lib/kubelet/pods/29019981-1664-4c52-bc0a-784c8061b931/volumes"
Nov 03 06:10:56.786252 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.786236    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" path="/var/lib/kubelet/pods/66151bde-baff-4252-849b-9a70cdcb4aec/volumes"
Nov 03 06:10:56.786859 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:56.786844    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" path="/var/lib/kubelet/pods/84bf9f7a-e132-446b-a527-a69f8885aceb/volumes"
Nov 03 06:10:57.119943 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.119904    4418 generic.go:356] "Generic (PLEG): container finished" podID="538fb4be-1740-4814-b31e-ca5fdc22b819" containerID="a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63" exitCode=0
Nov 03 06:10:57.120144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.119955    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"
Nov 03 06:10:57.120144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.119975    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" event={"ID":"538fb4be-1740-4814-b31e-ca5fdc22b819","Type":"ContainerDied","Data":"a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63"}
Nov 03 06:10:57.120144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.120050    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5" event={"ID":"538fb4be-1740-4814-b31e-ca5fdc22b819","Type":"ContainerDied","Data":"463dd2b75ee7159af3d27aefd4b25393c8ace8a96502a5d20510c41a92ef13fc"}
Nov 03 06:10:57.120144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.120086    4418 scope.go:122] "RemoveContainer" containerID="a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63"
Nov 03 06:10:57.121973 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.121948    4418 generic.go:356] "Generic (PLEG): container finished" podID="15ae3cf1-f453-4368-8843-fec7d202cdbe" containerID="493ea7d3eddcc7b5865ee8ce925bc2fb27a4bfe4e92b3a4bd35fed624f7eeb97" exitCode=0
Nov 03 06:10:57.122092 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.122071    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds" event={"ID":"15ae3cf1-f453-4368-8843-fec7d202cdbe","Type":"ContainerDied","Data":"493ea7d3eddcc7b5865ee8ce925bc2fb27a4bfe4e92b3a4bd35fed624f7eeb97"}
Nov 03 06:10:57.124777 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.124746    4418 generic.go:356] "Generic (PLEG): container finished" podID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerID="28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5" exitCode=0
Nov 03 06:10:57.124895 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.124783    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"
Nov 03 06:10:57.124895 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.124812    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" event={"ID":"776dbac9-7c0a-47b2-a2b4-eaf723467109","Type":"ContainerDied","Data":"28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5"}
Nov 03 06:10:57.124895 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.124838    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts" event={"ID":"776dbac9-7c0a-47b2-a2b4-eaf723467109","Type":"ContainerDied","Data":"1d1ee664380810c5673500c2b86d14ce6aadec64a73bc8e2dca6181329c8da7b"}
Nov 03 06:10:57.131862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.131835    4418 scope.go:122] "RemoveContainer" containerID="a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63"
Nov 03 06:10:57.132094 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:57.132075    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63\": container with ID starting with a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63 not found: ID does not exist" containerID="a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63"
Nov 03 06:10:57.132136 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.132103    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63"} err="failed to get container status \"a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63\": rpc error: code = NotFound desc = could not find container \"a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63\": container with ID starting with a37f968b1c37ff7cf34dade503e1c90d15c0cc3bea5b61ebcea639429accae63 not found: ID does not exist"
Nov 03 06:10:57.132136 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.132120    4418 scope.go:122] "RemoveContainer" containerID="28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5"
Nov 03 06:10:57.140864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.140848    4418 scope.go:122] "RemoveContainer" containerID="28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5"
Nov 03 06:10:57.141135 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:57.141116    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5\": container with ID starting with 28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5 not found: ID does not exist" containerID="28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5"
Nov 03 06:10:57.141223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.141144    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5"} err="failed to get container status \"28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5\": rpc error: code = NotFound desc = could not find container \"28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5\": container with ID starting with 28df7a13b6addd7a680d1a96c59892e9e633588ab42c0da340c29a8dd3b01ea5 not found: ID does not exist"
Nov 03 06:10:57.176796 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.176768    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"]
Nov 03 06:10:57.188638 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.188612    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-df7236/distinct-2-w0-df7236-kserve-5645f8f86d-xrhts"]
Nov 03 06:10:57.261752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.261725    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"]
Nov 03 06:10:57.268857 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.268832    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-be1a66-78d5494865-96ns5"]
Nov 03 06:10:57.984757 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:57.984694    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:10:58.018020 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.017983    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-kube-api-access-x7mqk\" (UniqueName: \"kubernetes.io/projected/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-kube-api-access-x7mqk\") pod \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") "
Nov 03 06:10:58.018185 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.018089    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-plugins-config-volume\") pod \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\" (UID: \"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0\") "
Nov 03 06:10:58.018475 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.018453    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-plugins-config-volume" pod "bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" (UID: "bbde71a0-af0e-4cfb-af11-b3cc1fef02b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:58.018757 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.018734    4418 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-plugins-config-volume\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:58.020238 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.020216    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-kube-api-access-x7mqk" pod "bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" (UID: "bbde71a0-af0e-4cfb-af11-b3cc1fef02b0"). InnerVolumeSpecName "kube-api-access-x7mqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:58.119835 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.119788    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7mqk\" (UniqueName: \"kubernetes.io/projected/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0-kube-api-access-x7mqk\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:58.136160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.136125    4418 generic.go:356] "Generic (PLEG): container finished" podID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" containerID="41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34" exitCode=0
Nov 03 06:10:58.136322 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.136179    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"
Nov 03 06:10:58.136322 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.136204    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" event={"ID":"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0","Type":"ContainerDied","Data":"41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34"}
Nov 03 06:10:58.136322 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.136257    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs" event={"ID":"bbde71a0-af0e-4cfb-af11-b3cc1fef02b0","Type":"ContainerDied","Data":"74da6b169296bada318c558445afd4760cc1850b1c35dfaa91c8d8b47b9d7ef7"}
Nov 03 06:10:58.136322 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.136281    4418 scope.go:122] "RemoveContainer" containerID="41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34"
Nov 03 06:10:58.146861 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.146843    4418 scope.go:122] "RemoveContainer" containerID="41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34"
Nov 03 06:10:58.147120 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:58.147103    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34\": container with ID starting with 41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34 not found: ID does not exist" containerID="41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34"
Nov 03 06:10:58.147163 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.147129    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34"} err="failed to get container status \"41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34\": rpc error: code = NotFound desc = could not find container \"41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34\": container with ID starting with 41713ae6c332990cf56c297d4b31bbd4f01e575a6bf19fd2b0b364e465440d34 not found: ID does not exist"
Nov 03 06:10:58.189354 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.189324    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"]
Nov 03 06:10:58.208891 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.208860    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-86728b-7597fbdb4c-28ncs"]
Nov 03 06:10:58.288041 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.288013    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:58.322296 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.322260    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15ae3cf1-f453-4368-8843-fec7d202cdbe-kube-api-access-kr69v\" (UniqueName: \"kubernetes.io/projected/15ae3cf1-f453-4368-8843-fec7d202cdbe-kube-api-access-kr69v\") pod \"15ae3cf1-f453-4368-8843-fec7d202cdbe\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") "
Nov 03 06:10:58.322455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.322307    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-openshift-ca\") pod \"15ae3cf1-f453-4368-8843-fec7d202cdbe\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") "
Nov 03 06:10:58.322455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.322360    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-xks-ca\") pod \"15ae3cf1-f453-4368-8843-fec7d202cdbe\" (UID: \"15ae3cf1-f453-4368-8843-fec7d202cdbe\") "
Nov 03 06:10:58.322839 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.322808    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-openshift-ca" pod "15ae3cf1-f453-4368-8843-fec7d202cdbe" (UID: "15ae3cf1-f453-4368-8843-fec7d202cdbe"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:10:58.323035 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.322998    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-openshift-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:58.353693 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.353655    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-xks-ca" pod "15ae3cf1-f453-4368-8843-fec7d202cdbe" (UID: "15ae3cf1-f453-4368-8843-fec7d202cdbe"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:10:58.353693 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.353688    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ae3cf1-f453-4368-8843-fec7d202cdbe-kube-api-access-kr69v" pod "15ae3cf1-f453-4368-8843-fec7d202cdbe" (UID: "15ae3cf1-f453-4368-8843-fec7d202cdbe"). InnerVolumeSpecName "kube-api-access-kr69v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:10:58.374297 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.374253    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:10:58.408812 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:10:58.408781    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:10:58.424744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.424717    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15ae3cf1-f453-4368-8843-fec7d202cdbe-maas-api-xks-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:58.424744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.424742    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr69v\" (UniqueName: \"kubernetes.io/projected/15ae3cf1-f453-4368-8843-fec7d202cdbe-kube-api-access-kr69v\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:10:58.785014 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.784981    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="538fb4be-1740-4814-b31e-ca5fdc22b819" path="/var/lib/kubelet/pods/538fb4be-1740-4814-b31e-ca5fdc22b819/volumes"
Nov 03 06:10:58.785601 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.785552    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" path="/var/lib/kubelet/pods/776dbac9-7c0a-47b2-a2b4-eaf723467109/volumes"
Nov 03 06:10:58.786080 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:58.786067    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" path="/var/lib/kubelet/pods/bbde71a0-af0e-4cfb-af11-b3cc1fef02b0/volumes"
Nov 03 06:10:59.144125 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:59.144100    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"
Nov 03 06:10:59.144563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:59.144132    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds" event={"ID":"15ae3cf1-f453-4368-8843-fec7d202cdbe","Type":"ContainerDied","Data":"ce70a6e42a3eb68d9ea8714e09142ee0ada9776fa47a81af660df3941be0e7ec"}
Nov 03 06:10:59.144563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:10:59.144182    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce70a6e42a3eb68d9ea8714e09142ee0ada9776fa47a81af660df3941be0e7ec"
Nov 03 06:11:00.162338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:00.160761    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:00.888445 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:00.888403    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:01.676890 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:01.676855    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"]
Nov 03 06:11:01.677899 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:01.677866    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr" podUID="fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" containerName="maas-api" containerID="cri-o://5207a992223ae2ff1b475d382b65d88c1c2d8daa82ba8ee3f669539b6ce00374" gracePeriod=30
Nov 03 06:11:01.795770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:01.795723    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:02.210711 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.210304    4418 generic.go:356] "Generic (PLEG): container finished" podID="fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" containerID="5207a992223ae2ff1b475d382b65d88c1c2d8daa82ba8ee3f669539b6ce00374" exitCode=0
Nov 03 06:11:02.210711 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.210541    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr" event={"ID":"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7","Type":"ContainerDied","Data":"5207a992223ae2ff1b475d382b65d88c1c2d8daa82ba8ee3f669539b6ce00374"}
Nov 03 06:11:02.367569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.366253    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:02.425235 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.425207    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:11:02.518719 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.518681    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-kube-api-access-6snvw\" (UniqueName: \"kubernetes.io/projected/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-kube-api-access-6snvw\") pod \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") "
Nov 03 06:11:02.518901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.518729    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-maas-api-tls\") pod \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") "
Nov 03 06:11:02.518901 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.518894    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-openshift-service-ca\") pod \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") "
Nov 03 06:11:02.519098 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.519018    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-metrics-certs\") pod \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\" (UID: \"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7\") "
Nov 03 06:11:02.519693 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.519663    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-openshift-service-ca" pod "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" (UID: "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:02.521017 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.520987    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-maas-api-tls" pod "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" (UID: "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:02.521540 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.521482    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-kube-api-access-6snvw" pod "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" (UID: "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7"). InnerVolumeSpecName "kube-api-access-6snvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:02.521647 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.521632    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-metrics-certs" pod "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" (UID: "fc4d463b-5e13-4b00-ba7c-de31ca33d4d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:02.569744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.569709    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:02.620807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.620745    4418 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-metrics-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:02.620807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.620771    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6snvw\" (UniqueName: \"kubernetes.io/projected/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-kube-api-access-6snvw\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:02.620807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.620785    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-maas-api-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:02.620807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.620799    4418 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7-openshift-service-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:02.742886 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.742854    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:02.957161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:02.957069    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:03.148110 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.148071    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:03.218670 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.218583    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr" event={"ID":"fc4d463b-5e13-4b00-ba7c-de31ca33d4d7","Type":"ContainerDied","Data":"ae6ceaf09b933c526dec7369098a27915115242442c4059454c47042caad6ddd"}
Nov 03 06:11:03.218670 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.218617    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"
Nov 03 06:11:03.218882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.218676    4418 scope.go:122] "RemoveContainer" containerID="5207a992223ae2ff1b475d382b65d88c1c2d8daa82ba8ee3f669539b6ce00374"
Nov 03 06:11:03.293935 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.290438    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"]
Nov 03 06:11:03.334522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.333438    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-be1a66-6584bf7d46-84pxr"]
Nov 03 06:11:03.352342 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.352312    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:03.778814 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.778780    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:03.944585 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:03.944551    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:04.119040 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:04.119010    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:04.506382 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:04.506301    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:04.731243 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:04.731213    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:04.784159 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:04.784087    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" path="/var/lib/kubelet/pods/fc4d463b-5e13-4b00-ba7c-de31ca33d4d7/volumes"
Nov 03 06:11:05.024613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:05.024581    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:05.797260 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:05.797230    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"]
Nov 03 06:11:05.828493 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:05.828466    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"]
Nov 03 06:11:05.978744 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:05.978656    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:06.142812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:06.142780    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:06.848172 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:06.848132    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:07.182421 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:07.182386    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:07.376932 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:07.376892    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:08.081305 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:08.081273    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:09.786407 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:09.786377    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"]
Nov 03 06:11:09.798384 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:09.798357    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"]
Nov 03 06:11:10.013957 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:10.013923    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:10.239250 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:10.239216    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:11.916461 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:11.916425    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:12.146580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:12.146544    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:12.539940 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:12.539906    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:13.164533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:13.164466    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:13.828197 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:13.828162    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:14.784518 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:14.784473    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:15.092195 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.092108    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:15.102341 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.102313    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"]
Nov 03 06:11:15.102569 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.102549    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" containerID="cri-o://909407a53e0b60468a887651edcebf2b7cd222b84c2986662da45e0c95fea2b5" gracePeriod=30
Nov 03 06:11:15.113755 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.113730    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"]
Nov 03 06:11:15.113933 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.113913    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" containerID="cri-o://970ddb85c37e09312b83154cfdf77af1341fecd9de0d53ee81f0dafccc5f80a5" gracePeriod=30
Nov 03 06:11:15.200144 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.200112    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"]
Nov 03 06:11:15.200336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.200315    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" containerID="cri-o://cb2581ebc900c9529d3bee32e211bff98e78500d1dc66eded6f3b21d436f2e85" gracePeriod=30
Nov 03 06:11:15.409035 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.408994    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:15.672254 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.672173    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"]
Nov 03 06:11:15.794964 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:15.794926    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:16.039680 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.039566    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:16.148433 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.148393    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"]
Nov 03 06:11:16.148697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.148671    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" containerID="cri-o://3ea50a79779d8ef81e497ddf4d83d5634ba88be792ab49b0da381c6b0fce69f6" gracePeriod=30
Nov 03 06:11:16.169991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.169959    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"]
Nov 03 06:11:16.170236 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.170212    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" containerID="cri-o://481c87ead7840582c6227e1d06008c25afaf8b0232452a2d3e4b46d32d28440d" gracePeriod=30
Nov 03 06:11:16.178073 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.178044    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"]
Nov 03 06:11:16.178275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.178248    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" containerID="cri-o://aed968c956570f6d9af02be17053ec2e8e72c9ecbed804941635799f5c5af477" gracePeriod=30
Nov 03 06:11:16.288876 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.288845    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:16.559611 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.559583    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:16.573493 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.573448    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:16.573687 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.573543    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:16.772213 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.772173    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"]
Nov 03 06:11:16.772519 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.772441    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" containerID="cri-o://02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9" gracePeriod=30
Nov 03 06:11:16.794893 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.793132    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"]
Nov 03 06:11:16.794893 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.793200    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"]
Nov 03 06:11:16.794893 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.793339    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy" containerID="cri-o://192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc" gracePeriod=30
Nov 03 06:11:16.794893 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.793549    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" containerID="cri-o://022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1" gracePeriod=30
Nov 03 06:11:16.914553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:16.911441    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:17.057434 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:17.057351    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Nov 03 06:11:17.057683 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:17.057433    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:17.328815 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:17.328721    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:17.982907 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:17.982858    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:17.983554 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:17.983521    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:18.672858 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:18.672813    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.58:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:11:19.437145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.437106    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:19.437736 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.437702    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:19.488064 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.488030    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:19.488221 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.488097    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:19.521303 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.521268    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:19.683329 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.683286    4418 patch_prober.go:29] interesting pod/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:19.683488 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.683351    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:19.710224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.710128    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:19.982011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.981925    4418 patch_prober.go:29] interesting pod/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:19.982011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:19.981991    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:20.376705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.376420    4418 generic.go:356] "Generic (PLEG): container finished" podID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerID="cb2581ebc900c9529d3bee32e211bff98e78500d1dc66eded6f3b21d436f2e85" exitCode=0
Nov 03 06:11:20.376705 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.376586    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" event={"ID":"295cd236-273a-41d4-b1ce-be6d1690a33c","Type":"ContainerDied","Data":"cb2581ebc900c9529d3bee32e211bff98e78500d1dc66eded6f3b21d436f2e85"}
Nov 03 06:11:20.378624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.378398    4418 generic.go:356] "Generic (PLEG): container finished" podID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerID="970ddb85c37e09312b83154cfdf77af1341fecd9de0d53ee81f0dafccc5f80a5" exitCode=0
Nov 03 06:11:20.378624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.378465    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" event={"ID":"90ff3960-8e55-4cc1-920c-ca62c7e76e16","Type":"ContainerDied","Data":"970ddb85c37e09312b83154cfdf77af1341fecd9de0d53ee81f0dafccc5f80a5"}
Nov 03 06:11:20.383521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.380438    4418 generic.go:356] "Generic (PLEG): container finished" podID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerID="909407a53e0b60468a887651edcebf2b7cd222b84c2986662da45e0c95fea2b5" exitCode=0
Nov 03 06:11:20.383521 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.380476    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" event={"ID":"573ba103-e498-42ed-bbf5-26cb9a559f87","Type":"ContainerDied","Data":"909407a53e0b60468a887651edcebf2b7cd222b84c2986662da45e0c95fea2b5"}
Nov 03 06:11:20.403514 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.403295    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:11:20.517055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.516980    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:11:20.532613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.532574    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-credential-socket\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.532791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.532714    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-certs\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.532791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.532750    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-kube-api-access-rnj6x\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-kube-api-access-rnj6x\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.532913 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.532809    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-podinfo\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.532977 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.532906    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/573ba103-e498-42ed-bbf5-26cb9a559f87-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573ba103-e498-42ed-bbf5-26cb9a559f87-istiod-ca-cert\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.533030 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.532984    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-socket\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.533085 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.533051    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-token\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-token\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.533170 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.533140    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-data\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.533225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.533212    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-envoy\") pod \"573ba103-e498-42ed-bbf5-26cb9a559f87\" (UID: \"573ba103-e498-42ed-bbf5-26cb9a559f87\") "
Nov 03 06:11:20.534699 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.534668    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-socket" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.534995 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.534971    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/573ba103-e498-42ed-bbf5-26cb9a559f87-istiod-ca-cert" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:20.535625 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.535562    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-certs" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.535972 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.535846    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-credential-socket" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.536404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.536316    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-data" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.536665 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.536633    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-envoy" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.536904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.536808    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-podinfo" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:20.537605 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.537581    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-token" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:20.550496 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.540700    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-kube-api-access-rnj6x" pod "573ba103-e498-42ed-bbf5-26cb9a559f87" (UID: "573ba103-e498-42ed-bbf5-26cb9a559f87"). InnerVolumeSpecName "kube-api-access-rnj6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:20.570105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.570077    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:11:20.634692 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.634588    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-certs\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.634929 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.634844    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-certs" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.635008 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.634965    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-data\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.635062 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.635005    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-envoy\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.635062 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.635053    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-token\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-token\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.635227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.635087    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-podinfo\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.635227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.635141    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istiod-ca-cert\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.635227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.635201    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-kube-api-access-7nbxl\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-kube-api-access-7nbxl\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.635456 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.635326    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-credential-socket\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.635456 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.635396    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-socket\") pod \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\" (UID: \"90ff3960-8e55-4cc1-920c-ca62c7e76e16\") "
Nov 03 06:11:20.636591 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636566    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636591 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636592    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636614    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636627    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636640    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636653    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnj6x\" (UniqueName: \"kubernetes.io/projected/573ba103-e498-42ed-bbf5-26cb9a559f87-kube-api-access-rnj6x\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636668    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573ba103-e498-42ed-bbf5-26cb9a559f87-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636680    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636692    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573ba103-e498-42ed-bbf5-26cb9a559f87-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.636817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636705    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573ba103-e498-42ed-bbf5-26cb9a559f87-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.637343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.636902    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istiod-ca-cert" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:20.637449 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.637416    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-socket" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.637682 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.637660    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-data" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.637838 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.637802    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-credential-socket" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.639129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.639108    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-kube-api-access-7nbxl" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "kube-api-access-7nbxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:20.639857 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.639820    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-envoy" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.639949 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.639905    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-podinfo" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:20.639993 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.639975    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-token" pod "90ff3960-8e55-4cc1-920c-ca62c7e76e16" (UID: "90ff3960-8e55-4cc1-920c-ca62c7e76e16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:20.673374 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.673334    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" podUID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" containerName="payload-pre-processing" containerID="cri-o://86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0" gracePeriod=25
Nov 03 06:11:20.737797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.737761    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-kube-api-access-tr6mp\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-kube-api-access-tr6mp\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.737990 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.737833    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-socket\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.737990 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.737962    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-token\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-token\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.738106 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738031    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-data\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.738167 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738131    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-credential-socket\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.738220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738150    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-socket" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.738220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738166    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-envoy\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.738329 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738267    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-podinfo\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.738329 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738316    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-certs\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.738444 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738374    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/295cd236-273a-41d4-b1ce-be6d1690a33c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295cd236-273a-41d4-b1ce-be6d1690a33c-istiod-ca-cert\") pod \"295cd236-273a-41d4-b1ce-be6d1690a33c\" (UID: \"295cd236-273a-41d4-b1ce-be6d1690a33c\") "
Nov 03 06:11:20.738444 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738412    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-data" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738639    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-credential-socket" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739022    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-certs" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739032    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739070    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739091    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739107    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.738955    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/295cd236-273a-41d4-b1ce-be6d1690a33c-istiod-ca-cert" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739121    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739135    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739150    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ff3960-8e55-4cc1-920c-ca62c7e76e16-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739164    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nbxl\" (UniqueName: \"kubernetes.io/projected/90ff3960-8e55-4cc1-920c-ca62c7e76e16-kube-api-access-7nbxl\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739178    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739196    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.739484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.739210    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ff3960-8e55-4cc1-920c-ca62c7e76e16-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.740258 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.740225    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-token" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:20.740549 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.740475    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-envoy" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:20.740636 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.740571    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-kube-api-access-tr6mp" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "kube-api-access-tr6mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:20.740684 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.740664    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-podinfo" pod "295cd236-273a-41d4-b1ce-be6d1690a33c" (UID: "295cd236-273a-41d4-b1ce-be6d1690a33c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:20.836325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.825758    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main" containerID="cri-o://cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add" gracePeriod=45
Nov 03 06:11:20.840759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.840728    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.840898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.840763    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.840898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.840778    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295cd236-273a-41d4-b1ce-be6d1690a33c-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.840898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.840791    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295cd236-273a-41d4-b1ce-be6d1690a33c-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.840898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.840804    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr6mp\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-kube-api-access-tr6mp\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.840898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.840818    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295cd236-273a-41d4-b1ce-be6d1690a33c-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:20.853057 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:20.853021    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main" containerID="cri-o://8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe" gracePeriod=45
Nov 03 06:11:21.364991 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.364961    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:11:21.369983 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.369952    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:11:21.388577 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.388540    4418 generic.go:356] "Generic (PLEG): container finished" podID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerID="cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add" exitCode=0
Nov 03 06:11:21.388747 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.388627    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" event={"ID":"c341b7fe-42a9-470a-9802-b813b1dc688d","Type":"ContainerDied","Data":"cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add"}
Nov 03 06:11:21.388747 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.388666    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl" event={"ID":"c341b7fe-42a9-470a-9802-b813b1dc688d","Type":"ContainerDied","Data":"1cf1f300126eda5f0ccdfb5083f203c99281d1d3c2117409200fdc9e2a08c80e"}
Nov 03 06:11:21.388747 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.388671    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"
Nov 03 06:11:21.388939 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.388817    4418 scope.go:122] "RemoveContainer" containerID="cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add"
Nov 03 06:11:21.392155 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.390640    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"
Nov 03 06:11:21.392155 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.390644    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl" event={"ID":"90ff3960-8e55-4cc1-920c-ca62c7e76e16","Type":"ContainerDied","Data":"bcf2540f4d850f98e6d2e6b4f5c41ac75ff3d30ab9bd8c3beddb216d5dd2d015"}
Nov 03 06:11:21.407836 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.407800    4418 generic.go:356] "Generic (PLEG): container finished" podID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerID="3ea50a79779d8ef81e497ddf4d83d5634ba88be792ab49b0da381c6b0fce69f6" exitCode=0
Nov 03 06:11:21.408674 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.408646    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" event={"ID":"84e6cf40-6ada-41c2-b797-c62c74c1c862","Type":"ContainerDied","Data":"3ea50a79779d8ef81e497ddf4d83d5634ba88be792ab49b0da381c6b0fce69f6"}
Nov 03 06:11:21.410832 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.410811    4418 generic.go:356] "Generic (PLEG): container finished" podID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerID="aed968c956570f6d9af02be17053ec2e8e72c9ecbed804941635799f5c5af477" exitCode=0
Nov 03 06:11:21.411382 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.411097    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" event={"ID":"be0a6235-7bfe-408f-a725-3e17537ea9ab","Type":"ContainerDied","Data":"aed968c956570f6d9af02be17053ec2e8e72c9ecbed804941635799f5c5af477"}
Nov 03 06:11:21.413806 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.413003    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp" event={"ID":"573ba103-e498-42ed-bbf5-26cb9a559f87","Type":"ContainerDied","Data":"35ca49e2b3d429371d846c31e721b014a37a1536490cde2759b2d291f3062ec1"}
Nov 03 06:11:21.413806 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.413112    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"
Nov 03 06:11:21.416938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.416809    4418 generic.go:356] "Generic (PLEG): container finished" podID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerID="481c87ead7840582c6227e1d06008c25afaf8b0232452a2d3e4b46d32d28440d" exitCode=0
Nov 03 06:11:21.416938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.416880    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" event={"ID":"b7a93263-1fc0-4249-a4c4-7dac8a90af34","Type":"ContainerDied","Data":"481c87ead7840582c6227e1d06008c25afaf8b0232452a2d3e4b46d32d28440d"}
Nov 03 06:11:21.420032 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.419895    4418 scope.go:122] "RemoveContainer" containerID="cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add"
Nov 03 06:11:21.420622 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:21.420590    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add\": container with ID starting with cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add not found: ID does not exist" containerID="cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add"
Nov 03 06:11:21.420807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.420783    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add"} err="failed to get container status \"cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add\": rpc error: code = NotFound desc = could not find container \"cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add\": container with ID starting with cb76cffcc9a9e453182f1242f360bfeea791403213f56f5296d0753f0e4c8add not found: ID does not exist"
Nov 03 06:11:21.420904 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.420894    4418 scope.go:122] "RemoveContainer" containerID="970ddb85c37e09312b83154cfdf77af1341fecd9de0d53ee81f0dafccc5f80a5"
Nov 03 06:11:21.421264 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.421242    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx" event={"ID":"295cd236-273a-41d4-b1ce-be6d1690a33c","Type":"ContainerDied","Data":"ebd1b719e4934482d5d65294cf46c9d890992ad4b6a40df77b15cb72f7362189"}
Nov 03 06:11:21.421474 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.421456    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"
Nov 03 06:11:21.424299 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.424278    4418 generic.go:356] "Generic (PLEG): container finished" podID="6f0caac6-1354-4401-9713-3cf60f31487f" containerID="8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe" exitCode=0
Nov 03 06:11:21.424395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.424319    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" event={"ID":"6f0caac6-1354-4401-9713-3cf60f31487f","Type":"ContainerDied","Data":"8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe"}
Nov 03 06:11:21.424395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.424340    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx" event={"ID":"6f0caac6-1354-4401-9713-3cf60f31487f","Type":"ContainerDied","Data":"25985ab822386d5ef6c10148e4033a83212ecd34d39c28cf1cd70f3f8b2f4ddc"}
Nov 03 06:11:21.424395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.424385    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"
Nov 03 06:11:21.447415 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.447391    4418 scope.go:122] "RemoveContainer" containerID="909407a53e0b60468a887651edcebf2b7cd222b84c2986662da45e0c95fea2b5"
Nov 03 06:11:21.463324 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463288    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f0caac6-1354-4401-9713-3cf60f31487f-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0caac6-1354-4401-9713-3cf60f31487f-tls-certs\") pod \"6f0caac6-1354-4401-9713-3cf60f31487f\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") "
Nov 03 06:11:21.463403 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463345    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-tmp-dir\") pod \"6f0caac6-1354-4401-9713-3cf60f31487f\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") "
Nov 03 06:11:21.463403 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463393    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-tmp-dir\") pod \"c341b7fe-42a9-470a-9802-b813b1dc688d\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") "
Nov 03 06:11:21.463468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463423    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-dshm\") pod \"c341b7fe-42a9-470a-9802-b813b1dc688d\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") "
Nov 03 06:11:21.463526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463477    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-dshm\") pod \"6f0caac6-1354-4401-9713-3cf60f31487f\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") "
Nov 03 06:11:21.463631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463616    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f0caac6-1354-4401-9713-3cf60f31487f-kube-api-access-qwbw2\" (UniqueName: \"kubernetes.io/projected/6f0caac6-1354-4401-9713-3cf60f31487f-kube-api-access-qwbw2\") pod \"6f0caac6-1354-4401-9713-3cf60f31487f\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") "
Nov 03 06:11:21.463703 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463689    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c341b7fe-42a9-470a-9802-b813b1dc688d-kube-api-access-gf65z\" (UniqueName: \"kubernetes.io/projected/c341b7fe-42a9-470a-9802-b813b1dc688d-kube-api-access-gf65z\") pod \"c341b7fe-42a9-470a-9802-b813b1dc688d\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") "
Nov 03 06:11:21.463741 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463728    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-home\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-home\") pod \"6f0caac6-1354-4401-9713-3cf60f31487f\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") "
Nov 03 06:11:21.463804 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463792    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-home\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-home\") pod \"c341b7fe-42a9-470a-9802-b813b1dc688d\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") "
Nov 03 06:11:21.463876 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463862    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-model-cache\") pod \"c341b7fe-42a9-470a-9802-b813b1dc688d\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") "
Nov 03 06:11:21.463914 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463894    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-model-cache\") pod \"6f0caac6-1354-4401-9713-3cf60f31487f\" (UID: \"6f0caac6-1354-4401-9713-3cf60f31487f\") "
Nov 03 06:11:21.463986 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.463969    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c341b7fe-42a9-470a-9802-b813b1dc688d-tls-certs\" (UniqueName: \"kubernetes.io/secret/c341b7fe-42a9-470a-9802-b813b1dc688d-tls-certs\") pod \"c341b7fe-42a9-470a-9802-b813b1dc688d\" (UID: \"c341b7fe-42a9-470a-9802-b813b1dc688d\") "
Nov 03 06:11:21.466397 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.465073    4418 scope.go:122] "RemoveContainer" containerID="cb2581ebc900c9529d3bee32e211bff98e78500d1dc66eded6f3b21d436f2e85"
Nov 03 06:11:21.468924 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.468647    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-tmp-dir" pod "c341b7fe-42a9-470a-9802-b813b1dc688d" (UID: "c341b7fe-42a9-470a-9802-b813b1dc688d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.469273 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.469205    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"]
Nov 03 06:11:21.470136 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.469880    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-home" pod "c341b7fe-42a9-470a-9802-b813b1dc688d" (UID: "c341b7fe-42a9-470a-9802-b813b1dc688d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.473127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.472439    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0caac6-1354-4401-9713-3cf60f31487f-kube-api-access-qwbw2" pod "6f0caac6-1354-4401-9713-3cf60f31487f" (UID: "6f0caac6-1354-4401-9713-3cf60f31487f"). InnerVolumeSpecName "kube-api-access-qwbw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.473127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.472696    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-home" pod "6f0caac6-1354-4401-9713-3cf60f31487f" (UID: "6f0caac6-1354-4401-9713-3cf60f31487f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.473127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.472904    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-model-cache" pod "c341b7fe-42a9-470a-9802-b813b1dc688d" (UID: "c341b7fe-42a9-470a-9802-b813b1dc688d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.473127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.472961    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c341b7fe-42a9-470a-9802-b813b1dc688d-kube-api-access-gf65z" pod "c341b7fe-42a9-470a-9802-b813b1dc688d" (UID: "c341b7fe-42a9-470a-9802-b813b1dc688d"). InnerVolumeSpecName "kube-api-access-gf65z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.473127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.472975    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-model-cache" pod "6f0caac6-1354-4401-9713-3cf60f31487f" (UID: "6f0caac6-1354-4401-9713-3cf60f31487f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.473127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.473107    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-tmp-dir" pod "6f0caac6-1354-4401-9713-3cf60f31487f" (UID: "6f0caac6-1354-4401-9713-3cf60f31487f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.474086 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.474052    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-dshm" pod "c341b7fe-42a9-470a-9802-b813b1dc688d" (UID: "c341b7fe-42a9-470a-9802-b813b1dc688d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.476388 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.476337    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-gptpl"]
Nov 03 06:11:21.476729 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.476703    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c341b7fe-42a9-470a-9802-b813b1dc688d-tls-certs" pod "c341b7fe-42a9-470a-9802-b813b1dc688d" (UID: "c341b7fe-42a9-470a-9802-b813b1dc688d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:21.476798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.476764    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-dshm" pod "6f0caac6-1354-4401-9713-3cf60f31487f" (UID: "6f0caac6-1354-4401-9713-3cf60f31487f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.479242 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.477616    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0caac6-1354-4401-9713-3cf60f31487f-tls-certs" pod "6f0caac6-1354-4401-9713-3cf60f31487f" (UID: "6f0caac6-1354-4401-9713-3cf60f31487f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:21.486759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.485646    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:11:21.486759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.486445    4418 scope.go:122] "RemoveContainer" containerID="8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe"
Nov 03 06:11:21.497961 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.497906    4418 scope.go:122] "RemoveContainer" containerID="8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe"
Nov 03 06:11:21.498802 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:21.498771    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe\": container with ID starting with 8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe not found: ID does not exist" containerID="8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe"
Nov 03 06:11:21.498990 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.498816    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe"} err="failed to get container status \"8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe\": rpc error: code = NotFound desc = could not find container \"8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe\": container with ID starting with 8d5876c394f423509c55e9996f954241c8c5f914a804c44074762f74becd11fe not found: ID does not exist"
Nov 03 06:11:21.565314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565278    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-envoy\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.565797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565333    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-credential-socket\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.565797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565380    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-certs\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.565797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565533    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/84e6cf40-6ada-41c2-b797-c62c74c1c862-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84e6cf40-6ada-41c2-b797-c62c74c1c862-istiod-ca-cert\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.565797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565566    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-kube-api-access-492dn\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-kube-api-access-492dn\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.565797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565615    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-data\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.565797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565685    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-socket\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.565797 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565727    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-token\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-token\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.566189 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.565813    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-podinfo\") pod \"84e6cf40-6ada-41c2-b797-c62c74c1c862\" (UID: \"84e6cf40-6ada-41c2-b797-c62c74c1c862\") "
Nov 03 06:11:21.566731 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.566707    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e6cf40-6ada-41c2-b797-c62c74c1c862-istiod-ca-cert" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:21.567259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.566983    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-socket" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.567259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.567202    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-credential-socket" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.567259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.567230    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-certs" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.567590 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.567561    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-data" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.567933 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.567915    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f0caac6-1354-4401-9713-3cf60f31487f-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568042 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568030    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568134    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568233 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568223    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568324 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568314    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568398    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84e6cf40-6ada-41c2-b797-c62c74c1c862-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568484 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568474    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568609 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568595    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwbw2\" (UniqueName: \"kubernetes.io/projected/6f0caac6-1354-4401-9713-3cf60f31487f-kube-api-access-qwbw2\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568710 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568697    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568794 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568780    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf65z\" (UniqueName: \"kubernetes.io/projected/c341b7fe-42a9-470a-9802-b813b1dc688d-kube-api-access-gf65z\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568883 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568872    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.568961 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.568951    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.569046 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.569035    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c341b7fe-42a9-470a-9802-b813b1dc688d-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.569133 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.569122    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f0caac6-1354-4401-9713-3cf60f31487f-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.569217 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.569207    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.569366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.569352    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c341b7fe-42a9-470a-9802-b813b1dc688d-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.569454 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.569444    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.579986 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.579955    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-kube-api-access-492dn" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "kube-api-access-492dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.581675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.581624    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-podinfo" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:21.582326 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.582305    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-token" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.582414 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.582399    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-envoy" pod "84e6cf40-6ada-41c2-b797-c62c74c1c862" (UID: "84e6cf40-6ada-41c2-b797-c62c74c1c862"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.601573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.601551    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:11:21.615921 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.615861    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"]
Nov 03 06:11:21.615921 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.615889    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:11:21.628879 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.628851    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-xb7zp"]
Nov 03 06:11:21.671052 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.671021    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.671052 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.671050    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-492dn\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-kube-api-access-492dn\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.671359 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.671065    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.671359 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.671079    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84e6cf40-6ada-41c2-b797-c62c74c1c862-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.724900 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.724859    4418 patch_prober.go:29] interesting pod/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:21.725074 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.724924    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:21.733291 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.733262    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"]
Nov 03 06:11:21.741677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.741646    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-86728b-openshift-default-6c6f76ddd7-tnqtx"]
Nov 03 06:11:21.771728 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.771697    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-kube-api-access-75slz\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-kube-api-access-75slz\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.771886 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.771754    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-socket\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.771886 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.771790    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-podinfo\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.771886 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.771811    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-token\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-token\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.771886 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.771840    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-envoy\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.771886 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.771871    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-certs\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.772142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.771903    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-credential-socket\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.772142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772014    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-kube-api-access-q246k\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-kube-api-access-q246k\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.772142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772047    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-data\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.772142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772073    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-socket\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.772142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772109    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-podinfo\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.772380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772146    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-token\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-token\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.772380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772199    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-data\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.772380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772236    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-certs\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.772380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772286    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be0a6235-7bfe-408f-a725-3e17537ea9ab-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0a6235-7bfe-408f-a725-3e17537ea9ab-istiod-ca-cert\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.772380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772315    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istiod-ca-cert\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.772380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772345    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-envoy\") pod \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\" (UID: \"b7a93263-1fc0-4249-a4c4-7dac8a90af34\") "
Nov 03 06:11:21.772380 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772372    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-credential-socket\") pod \"be0a6235-7bfe-408f-a725-3e17537ea9ab\" (UID: \"be0a6235-7bfe-408f-a725-3e17537ea9ab\") "
Nov 03 06:11:21.772755 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772427    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-socket" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.772755 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.772667    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-socket" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.773059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.773019    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.773059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.773047    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.773229 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.773100    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-credential-socket" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.773553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.773531    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-certs" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.774560 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.774258    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-data" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.774655 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.773992    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0a6235-7bfe-408f-a725-3e17537ea9ab-istiod-ca-cert" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:21.774655 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.774241    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-data" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.774655 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.774274    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-credential-socket" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.774860 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.774767    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istiod-ca-cert" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:21.774971 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.774947    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-certs" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.775113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.774988    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-token" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.776954 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.776933    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-kube-api-access-75slz" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "kube-api-access-75slz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.777983 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.777952    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-podinfo" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:21.777983 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.777967    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-podinfo" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:21.778090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.777992    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-token" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.778090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.778026    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-kube-api-access-q246k" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "kube-api-access-q246k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:21.778650 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.778627    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-envoy" pod "be0a6235-7bfe-408f-a725-3e17537ea9ab" (UID: "be0a6235-7bfe-408f-a725-3e17537ea9ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.779333 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.779304    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-envoy" pod "b7a93263-1fc0-4249-a4c4-7dac8a90af34" (UID: "b7a93263-1fc0-4249-a4c4-7dac8a90af34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:21.838518 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.838462    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"]
Nov 03 06:11:21.842704 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.842678    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/simulator-w2-5c3542-kserve-86c5798447-8x4tx"]
Nov 03 06:11:21.874831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874763    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75slz\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-kube-api-access-75slz\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.874831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874789    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.874831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874801    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.874831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874815    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.874831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874824    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.874831 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874835    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874844    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q246k\" (UniqueName: \"kubernetes.io/projected/b7a93263-1fc0-4249-a4c4-7dac8a90af34-kube-api-access-q246k\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874852    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874860    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874868    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be0a6235-7bfe-408f-a725-3e17537ea9ab-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874876    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874891    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874901    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be0a6235-7bfe-408f-a725-3e17537ea9ab-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874909    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874916    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7a93263-1fc0-4249-a4c4-7dac8a90af34-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.875208 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.874925    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be0a6235-7bfe-408f-a725-3e17537ea9ab-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:21.879592 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.879565    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"]
Nov 03 06:11:21.880952 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:21.880930    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-5c3542/distinct-w2-5c3542-kserve-7bc887699c-8cfcl"]
Nov 03 06:11:22.096696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.096670    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:11:22.197990 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.197962    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:11:22.201169 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.201141    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:11:22.281068 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281038    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-envoy\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281077    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7b4ea53-0f14-4371-807d-809bb5d5b956-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b4ea53-0f14-4371-807d-809bb5d5b956-istiod-ca-cert\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281109    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-credential-socket\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281174    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-data\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281219    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-podinfo\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281443 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281239    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-kube-api-access-kpdvq\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-kube-api-access-kpdvq\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281443 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281272    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-token\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-token\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281443 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281324    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-certs\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281443 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281422    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-socket\") pod \"e7b4ea53-0f14-4371-807d-809bb5d5b956\" (UID: \"e7b4ea53-0f14-4371-807d-809bb5d5b956\") "
Nov 03 06:11:22.281641 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281449    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-credential-socket" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.281641 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281523    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-data" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.281641 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281547    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7b4ea53-0f14-4371-807d-809bb5d5b956-istiod-ca-cert" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:22.281804 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281687    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-certs" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.281851 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.281807    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-socket" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.282180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.282097    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7b4ea53-0f14-4371-807d-809bb5d5b956-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.282180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.282120    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.282180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.282134    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.282180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.282149    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.282180 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.282158    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.283543 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.283513    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-token" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:22.283642 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.283625    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-kube-api-access-kpdvq" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "kube-api-access-kpdvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:22.283732 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.283712    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-envoy" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.283824 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.283808    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-podinfo" pod "e7b4ea53-0f14-4371-807d-809bb5d5b956" (UID: "e7b4ea53-0f14-4371-807d-809bb5d5b956"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:22.349651 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.349608    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" podUID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 06:11:22.382707 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382671    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-token\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-token\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.382872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382718    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-data\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.382872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382757    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-credential-socket\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.382872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382787    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-envoy\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.382872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382805    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-kube-api-access-ffvfp\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-kube-api-access-ffvfp\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.382872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382832    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6019bcd0-2450-4042-ab89-10c5e8f43379-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6019bcd0-2450-4042-ab89-10c5e8f43379-istiod-ca-cert\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.382872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382855    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7353a86e-334f-40f0-ab22-a1c837591d17-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7353a86e-334f-40f0-ab22-a1c837591d17-istiod-ca-cert\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382879    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-envoy\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382907    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-data\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382933    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-socket\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382964    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-certs\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.382987    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-credential-socket\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.383023    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-podinfo\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.383056    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-socket\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.383085    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-kube-api-access-cblk5\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-kube-api-access-cblk5\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.383107    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-istio-token\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-istio-token\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.383157    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7353a86e-334f-40f0-ab22-a1c837591d17-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7353a86e-334f-40f0-ab22-a1c837591d17-istio-podinfo\") pod \"7353a86e-334f-40f0-ab22-a1c837591d17\" (UID: \"7353a86e-334f-40f0-ab22-a1c837591d17\") "
Nov 03 06:11:22.383192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.383181    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-certs\") pod \"6019bcd0-2450-4042-ab89-10c5e8f43379\" (UID: \"6019bcd0-2450-4042-ab89-10c5e8f43379\") "
Nov 03 06:11:22.383580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.383488    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.384355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384076    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-certs" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.384355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384084    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-data" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.384355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384104    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6019bcd0-2450-4042-ab89-10c5e8f43379-istiod-ca-cert" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:22.384355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384281    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-socket" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.384677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384380    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7353a86e-334f-40f0-ab22-a1c837591d17-istiod-ca-cert" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:22.384677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384457    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-data" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.384779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384731    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.384779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384759    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpdvq\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-kube-api-access-kpdvq\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.384779 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384775    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b4ea53-0f14-4371-807d-809bb5d5b956-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.385003 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.384981    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-certs" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.386775 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.386748    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-istio-token" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:22.386885 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.386860    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-token" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:22.386992 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.386973    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-socket" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.387113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.387090    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-credential-socket" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.387225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.387165    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-credential-socket" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.388735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.388677    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-envoy" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.389014 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.388980    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-podinfo" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:22.389257 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.389225    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-kube-api-access-cblk5" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "kube-api-access-cblk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:22.389538 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.389492    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-envoy" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:22.389631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.389541    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7353a86e-334f-40f0-ab22-a1c837591d17-istio-podinfo" pod "7353a86e-334f-40f0-ab22-a1c837591d17" (UID: "7353a86e-334f-40f0-ab22-a1c837591d17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:22.389631 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.389568    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-kube-api-access-ffvfp" pod "6019bcd0-2450-4042-ab89-10c5e8f43379" (UID: "6019bcd0-2450-4042-ab89-10c5e8f43379"). InnerVolumeSpecName "kube-api-access-ffvfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:22.431140 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.431107    4418 generic.go:356] "Generic (PLEG): container finished" podID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerID="192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc" exitCode=0
Nov 03 06:11:22.431312 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.431155    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"
Nov 03 06:11:22.431312 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.431204    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" event={"ID":"6019bcd0-2450-4042-ab89-10c5e8f43379","Type":"ContainerDied","Data":"192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc"}
Nov 03 06:11:22.431312 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.431266    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6" event={"ID":"6019bcd0-2450-4042-ab89-10c5e8f43379","Type":"ContainerDied","Data":"82ec948998bcc27b74e347ab20a09d611fafdf1fcfbc07f298db144fecefccd3"}
Nov 03 06:11:22.431312 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.431293    4418 scope.go:122] "RemoveContainer" containerID="192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc"
Nov 03 06:11:22.432668 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.432633    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27" event={"ID":"b7a93263-1fc0-4249-a4c4-7dac8a90af34","Type":"ContainerDied","Data":"5694d7465b12b355299b33020efd5d1b74ec4e830d50f1d2688f0e00cf549475"}
Nov 03 06:11:22.432668 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.432666    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"
Nov 03 06:11:22.442861 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.439041    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w" event={"ID":"84e6cf40-6ada-41c2-b797-c62c74c1c862","Type":"ContainerDied","Data":"a72b32fdea14eefb7b012f3233d06c242415fa54a4ffed1bbcadbfcf96fa295b"}
Nov 03 06:11:22.442861 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.439171    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"
Nov 03 06:11:22.446979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.445626    4418 generic.go:356] "Generic (PLEG): container finished" podID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerID="02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9" exitCode=0
Nov 03 06:11:22.446979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.445710    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" event={"ID":"e7b4ea53-0f14-4371-807d-809bb5d5b956","Type":"ContainerDied","Data":"02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9"}
Nov 03 06:11:22.446979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.445754    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9" event={"ID":"e7b4ea53-0f14-4371-807d-809bb5d5b956","Type":"ContainerDied","Data":"dc7c3d35a7141726c74b0b614533b952d386e43b38b0851c8ce7e9ca5255048c"}
Nov 03 06:11:22.446979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.445836    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"
Nov 03 06:11:22.449192 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.449169    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4" event={"ID":"be0a6235-7bfe-408f-a725-3e17537ea9ab","Type":"ContainerDied","Data":"db5d10bdcc2bbf95bb960bfd2fb5b263af771d57d4479481142685c3468e044e"}
Nov 03 06:11:22.449269 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.449260    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"
Nov 03 06:11:22.452011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.451983    4418 generic.go:356] "Generic (PLEG): container finished" podID="7353a86e-334f-40f0-ab22-a1c837591d17" containerID="022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1" exitCode=0
Nov 03 06:11:22.452097 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.452055    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" event={"ID":"7353a86e-334f-40f0-ab22-a1c837591d17","Type":"ContainerDied","Data":"022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1"}
Nov 03 06:11:22.452151 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.452107    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z" event={"ID":"7353a86e-334f-40f0-ab22-a1c837591d17","Type":"ContainerDied","Data":"167353ee11aa7e1487e8a232d5aa2dc9b18984c6f56b02025d8a4f6823b2000a"}
Nov 03 06:11:22.453587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.453479    4418 scope.go:122] "RemoveContainer" containerID="192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc"
Nov 03 06:11:22.453859 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.453837    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"
Nov 03 06:11:22.454109 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:22.454083    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc\": container with ID starting with 192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc not found: ID does not exist" containerID="192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc"
Nov 03 06:11:22.454213 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.454119    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc"} err="failed to get container status \"192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc\": rpc error: code = NotFound desc = could not find container \"192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc\": container with ID starting with 192cd385514cbaeed60ac5e321ea2fa3b6ebb73b1bfbce9ca21e658ee1bd03bc not found: ID does not exist"
Nov 03 06:11:22.454213 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.454141    4418 scope.go:122] "RemoveContainer" containerID="481c87ead7840582c6227e1d06008c25afaf8b0232452a2d3e4b46d32d28440d"
Nov 03 06:11:22.466242 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.466218    4418 scope.go:122] "RemoveContainer" containerID="3ea50a79779d8ef81e497ddf4d83d5634ba88be792ab49b0da381c6b0fce69f6"
Nov 03 06:11:22.477230 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.477215    4418 scope.go:122] "RemoveContainer" containerID="02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9"
Nov 03 06:11:22.486182 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486160    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7353a86e-334f-40f0-ab22-a1c837591d17-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486182 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486182    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486192    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486200    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486208    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486216    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486225    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffvfp\" (UniqueName: \"kubernetes.io/projected/6019bcd0-2450-4042-ab89-10c5e8f43379-kube-api-access-ffvfp\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486233    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6019bcd0-2450-4042-ab89-10c5e8f43379-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486242    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7353a86e-334f-40f0-ab22-a1c837591d17-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486249    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486257    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486264    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6019bcd0-2450-4042-ab89-10c5e8f43379-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486271    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486279    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486286    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6019bcd0-2450-4042-ab89-10c5e8f43379-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486294    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7353a86e-334f-40f0-ab22-a1c837591d17-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486302    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cblk5\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-kube-api-access-cblk5\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486323 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486309    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7353a86e-334f-40f0-ab22-a1c837591d17-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:22.486890 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.486822    4418 scope.go:122] "RemoveContainer" containerID="02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9"
Nov 03 06:11:22.487122 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:22.487102    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9\": container with ID starting with 02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9 not found: ID does not exist" containerID="02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9"
Nov 03 06:11:22.487162 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.487131    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9"} err="failed to get container status \"02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9\": rpc error: code = NotFound desc = could not find container \"02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9\": container with ID starting with 02616c94aba21d1b51dbdda2c7022e427b4b34e57941b1e5a38a373ba3b52bb9 not found: ID does not exist"
Nov 03 06:11:22.487162 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.487155    4418 scope.go:122] "RemoveContainer" containerID="aed968c956570f6d9af02be17053ec2e8e72c9ecbed804941635799f5c5af477"
Nov 03 06:11:22.495887 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.495870    4418 scope.go:122] "RemoveContainer" containerID="022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1"
Nov 03 06:11:22.504447 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.504431    4418 scope.go:122] "RemoveContainer" containerID="022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1"
Nov 03 06:11:22.504724 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:22.504704    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1\": container with ID starting with 022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1 not found: ID does not exist" containerID="022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1"
Nov 03 06:11:22.504798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.504731    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1"} err="failed to get container status \"022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1\": rpc error: code = NotFound desc = could not find container \"022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1\": container with ID starting with 022dca2e304dcf962a1a77c7e799e1de5ba99202b2822d786d0ad75f8d7ceae1 not found: ID does not exist"
Nov 03 06:11:22.554472 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.554437    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"]
Nov 03 06:11:22.558685 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.558649    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-wbtw4"]
Nov 03 06:11:22.606968 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.606932    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"]
Nov 03 06:11:22.620956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.620923    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-nxq27"]
Nov 03 06:11:22.671438 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.671363    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"]
Nov 03 06:11:22.675446 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.675411    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-kvhb9"]
Nov 03 06:11:22.722246 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.722212    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"]
Nov 03 06:11:22.727463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.727433    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-594p6"]
Nov 03 06:11:22.771427 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.771389    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"]
Nov 03 06:11:22.785080 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.785049    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" path="/var/lib/kubelet/pods/295cd236-273a-41d4-b1ce-be6d1690a33c/volumes"
Nov 03 06:11:22.785553 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.785538    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" path="/var/lib/kubelet/pods/573ba103-e498-42ed-bbf5-26cb9a559f87/volumes"
Nov 03 06:11:22.785953 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.785941    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" path="/var/lib/kubelet/pods/6019bcd0-2450-4042-ab89-10c5e8f43379/volumes"
Nov 03 06:11:22.786659 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.786644    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" path="/var/lib/kubelet/pods/6f0caac6-1354-4401-9713-3cf60f31487f/volumes"
Nov 03 06:11:22.787063 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.787050    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" path="/var/lib/kubelet/pods/90ff3960-8e55-4cc1-920c-ca62c7e76e16/volumes"
Nov 03 06:11:22.787455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.787442    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" path="/var/lib/kubelet/pods/b7a93263-1fc0-4249-a4c4-7dac8a90af34/volumes"
Nov 03 06:11:22.788151 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.788136    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" path="/var/lib/kubelet/pods/be0a6235-7bfe-408f-a725-3e17537ea9ab/volumes"
Nov 03 06:11:22.788519 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.788490    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" path="/var/lib/kubelet/pods/c341b7fe-42a9-470a-9802-b813b1dc688d/volumes"
Nov 03 06:11:22.788923 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.788911    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" path="/var/lib/kubelet/pods/e7b4ea53-0f14-4371-807d-809bb5d5b956/volumes"
Nov 03 06:11:22.789449 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.789435    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-be1a66-openshift-default-b858d5bf5-zlp5w"]
Nov 03 06:11:22.821580 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.821540    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"]
Nov 03 06:11:22.825424 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:22.825393    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-df7236-openshift-default-6879978f5c-47n8z"]
Nov 03 06:11:23.959133 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:23.959102    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:24.206435 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:24.206403    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:24.439497 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:24.439457    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:24.783338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:24.783257    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" path="/var/lib/kubelet/pods/7353a86e-334f-40f0-ab22-a1c837591d17/volumes"
Nov 03 06:11:24.783793 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:24.783778    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" path="/var/lib/kubelet/pods/84e6cf40-6ada-41c2-b797-c62c74c1c862/volumes"
Nov 03 06:11:24.807658 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:24.807623    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" containerID="cri-o://a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9" gracePeriod=45
Nov 03 06:11:24.821024 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:24.820967    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main" containerID="cri-o://2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28" gracePeriod=45
Nov 03 06:11:25.095617 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.095593    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:11:25.117403 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.117371    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:11:25.216105 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.216069    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f5dad80-945c-4941-81a9-94367d37de44-kube-api-access-z8lks\" (UniqueName: \"kubernetes.io/projected/1f5dad80-945c-4941-81a9-94367d37de44-kube-api-access-z8lks\") pod \"1f5dad80-945c-4941-81a9-94367d37de44\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") "
Nov 03 06:11:25.216328 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.216270    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-tmp-dir\") pod \"1f5dad80-945c-4941-81a9-94367d37de44\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") "
Nov 03 06:11:25.216404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.216356    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-dshm\") pod \"1f5dad80-945c-4941-81a9-94367d37de44\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") "
Nov 03 06:11:25.216404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.216382    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-model-cache\") pod \"1f5dad80-945c-4941-81a9-94367d37de44\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") "
Nov 03 06:11:25.216544 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.216421    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-home\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-home\") pod \"1f5dad80-945c-4941-81a9-94367d37de44\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") "
Nov 03 06:11:25.216544 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.216451    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f5dad80-945c-4941-81a9-94367d37de44-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5dad80-945c-4941-81a9-94367d37de44-tls-certs\") pod \"1f5dad80-945c-4941-81a9-94367d37de44\" (UID: \"1f5dad80-945c-4941-81a9-94367d37de44\") "
Nov 03 06:11:25.218870 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.218835    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-tmp-dir" pod "1f5dad80-945c-4941-81a9-94367d37de44" (UID: "1f5dad80-945c-4941-81a9-94367d37de44"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.219224 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.219188    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-home" pod "1f5dad80-945c-4941-81a9-94367d37de44" (UID: "1f5dad80-945c-4941-81a9-94367d37de44"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.219365 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.219254    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-model-cache" pod "1f5dad80-945c-4941-81a9-94367d37de44" (UID: "1f5dad80-945c-4941-81a9-94367d37de44"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.219939 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.219904    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-dshm" pod "1f5dad80-945c-4941-81a9-94367d37de44" (UID: "1f5dad80-945c-4941-81a9-94367d37de44"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.221028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.221006    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f5dad80-945c-4941-81a9-94367d37de44-tls-certs" pod "1f5dad80-945c-4941-81a9-94367d37de44" (UID: "1f5dad80-945c-4941-81a9-94367d37de44"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:25.222201 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.222178    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f5dad80-945c-4941-81a9-94367d37de44-kube-api-access-z8lks" pod "1f5dad80-945c-4941-81a9-94367d37de44" (UID: "1f5dad80-945c-4941-81a9-94367d37de44"). InnerVolumeSpecName "kube-api-access-z8lks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:25.318237 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.318132    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-dshm\") pod \"840055d2-ee63-4220-9fa1-536a5bd7fde4\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") "
Nov 03 06:11:25.318395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.318264    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/840055d2-ee63-4220-9fa1-536a5bd7fde4-kube-api-access-fgbkx\" (UniqueName: \"kubernetes.io/projected/840055d2-ee63-4220-9fa1-536a5bd7fde4-kube-api-access-fgbkx\") pod \"840055d2-ee63-4220-9fa1-536a5bd7fde4\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") "
Nov 03 06:11:25.318395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.318385    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-home\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-home\") pod \"840055d2-ee63-4220-9fa1-536a5bd7fde4\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") "
Nov 03 06:11:25.318524 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.318437    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/840055d2-ee63-4220-9fa1-536a5bd7fde4-tls-certs\" (UniqueName: \"kubernetes.io/secret/840055d2-ee63-4220-9fa1-536a5bd7fde4-tls-certs\") pod \"840055d2-ee63-4220-9fa1-536a5bd7fde4\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") "
Nov 03 06:11:25.318620 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.318585    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-model-cache\") pod \"840055d2-ee63-4220-9fa1-536a5bd7fde4\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") "
Nov 03 06:11:25.318688 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.318649    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-tmp-dir\") pod \"840055d2-ee63-4220-9fa1-536a5bd7fde4\" (UID: \"840055d2-ee63-4220-9fa1-536a5bd7fde4\") "
Nov 03 06:11:25.318737 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.318673    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-home" pod "840055d2-ee63-4220-9fa1-536a5bd7fde4" (UID: "840055d2-ee63-4220-9fa1-536a5bd7fde4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.319273 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319244    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.319273 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319274    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8lks\" (UniqueName: \"kubernetes.io/projected/1f5dad80-945c-4941-81a9-94367d37de44-kube-api-access-z8lks\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.319470 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319289    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.319470 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319303    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.319470 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319324    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.319470 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319336    4418 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f5dad80-945c-4941-81a9-94367d37de44-home\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.319470 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319350    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5dad80-945c-4941-81a9-94367d37de44-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.319865 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319831    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-model-cache" pod "840055d2-ee63-4220-9fa1-536a5bd7fde4" (UID: "840055d2-ee63-4220-9fa1-536a5bd7fde4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.319934 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.319918    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-tmp-dir" pod "840055d2-ee63-4220-9fa1-536a5bd7fde4" (UID: "840055d2-ee63-4220-9fa1-536a5bd7fde4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.320880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.320857    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-dshm" pod "840055d2-ee63-4220-9fa1-536a5bd7fde4" (UID: "840055d2-ee63-4220-9fa1-536a5bd7fde4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:25.320880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.320867    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/840055d2-ee63-4220-9fa1-536a5bd7fde4-tls-certs" pod "840055d2-ee63-4220-9fa1-536a5bd7fde4" (UID: "840055d2-ee63-4220-9fa1-536a5bd7fde4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:25.321069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.320867    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840055d2-ee63-4220-9fa1-536a5bd7fde4-kube-api-access-fgbkx" pod "840055d2-ee63-4220-9fa1-536a5bd7fde4" (UID: "840055d2-ee63-4220-9fa1-536a5bd7fde4"). InnerVolumeSpecName "kube-api-access-fgbkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:25.358448 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.358406    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:25.419917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.419872    4418 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-model-cache\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.419917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.419905    4418 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-tmp-dir\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.419917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.419914    4418 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/840055d2-ee63-4220-9fa1-536a5bd7fde4-dshm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.419917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.419925    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgbkx\" (UniqueName: \"kubernetes.io/projected/840055d2-ee63-4220-9fa1-536a5bd7fde4-kube-api-access-fgbkx\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.420268 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.419934    4418 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/840055d2-ee63-4220-9fa1-536a5bd7fde4-tls-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:25.484101 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.483938    4418 generic.go:356] "Generic (PLEG): container finished" podID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerID="2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28" exitCode=0
Nov 03 06:11:25.484101 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.484006    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"
Nov 03 06:11:25.484325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.484099    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" event={"ID":"840055d2-ee63-4220-9fa1-536a5bd7fde4","Type":"ContainerDied","Data":"2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28"}
Nov 03 06:11:25.484325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.484154    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5" event={"ID":"840055d2-ee63-4220-9fa1-536a5bd7fde4","Type":"ContainerDied","Data":"c676b65bdb1bd1583873f0600fe93c1039229d07b8e89e3db6b58afc721cc2d2"}
Nov 03 06:11:25.484325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.484179    4418 scope.go:122] "RemoveContainer" containerID="2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28"
Nov 03 06:11:25.486223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.486199    4418 generic.go:356] "Generic (PLEG): container finished" podID="1f5dad80-945c-4941-81a9-94367d37de44" containerID="a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9" exitCode=0
Nov 03 06:11:25.486408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.486265    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"
Nov 03 06:11:25.486713 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.486283    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" event={"ID":"1f5dad80-945c-4941-81a9-94367d37de44","Type":"ContainerDied","Data":"a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9"}
Nov 03 06:11:25.486713 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.486582    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" event={"ID":"1f5dad80-945c-4941-81a9-94367d37de44","Type":"ContainerDied","Data":"d519e34ca0924a6b520289f8b27b1bb63780ba375b24a0618ab0fe8c209c9316"}
Nov 03 06:11:25.498352 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.498330    4418 scope.go:122] "RemoveContainer" containerID="2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28"
Nov 03 06:11:25.498768 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:25.498732    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28\": container with ID starting with 2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28 not found: ID does not exist" containerID="2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28"
Nov 03 06:11:25.498889 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.498769    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28"} err="failed to get container status \"2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28\": rpc error: code = NotFound desc = could not find container \"2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28\": container with ID starting with 2fdb0e34f5c3667bd717ee1e5af2894dbd88fe2b1cfbb60241fc8e2871ff0a28 not found: ID does not exist"
Nov 03 06:11:25.498889 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.498795    4418 scope.go:122] "RemoveContainer" containerID="a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9"
Nov 03 06:11:25.513907 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.513877    4418 scope.go:122] "RemoveContainer" containerID="a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9"
Nov 03 06:11:25.514275 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:25.514248    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9\": container with ID starting with a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9 not found: ID does not exist" containerID="a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9"
Nov 03 06:11:25.514351 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.514286    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9"} err="failed to get container status \"a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9\": rpc error: code = NotFound desc = could not find container \"a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9\": container with ID starting with a9f5ecf89272ccf7a3e59f34bc09296798365d89338681dbd4039bafa9c9b8d9 not found: ID does not exist"
Nov 03 06:11:25.543757 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.543708    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"]
Nov 03 06:11:25.554696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.554644    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm"]
Nov 03 06:11:25.586853 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.586769    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"]
Nov 03 06:11:25.593330 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.593301    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-9688d8/simulator-w1-9688d8-kserve-6c58d7cd9c-c4qf5"]
Nov 03 06:11:25.891630 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:25.891593    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:26.032638 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:26.032591    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-9688d8/premium-w1-9688d8-kserve-7965f4f98d-gjghm" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main" probeResult="failure" output="Get \"https://10.134.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:11:26.080352 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:26.080318    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:26.628235 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:26.628203    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:26.783826 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:26.783791    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f5dad80-945c-4941-81a9-94367d37de44" path="/var/lib/kubelet/pods/1f5dad80-945c-4941-81a9-94367d37de44/volumes"
Nov 03 06:11:26.784253 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:26.784239    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" path="/var/lib/kubelet/pods/840055d2-ee63-4220-9fa1-536a5bd7fde4/volumes"
Nov 03 06:11:28.405705 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:28.405672    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:11:30.990468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:30.990431    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:32.350811 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.350771    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" podUID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 06:11:32.530958 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.530901    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:32.733204 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.733171    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:32.850290 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.850242    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"]
Nov 03 06:11:32.850537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.850487    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" containerID="cri-o://ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2" gracePeriod=30
Nov 03 06:11:32.868686 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.868653    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"]
Nov 03 06:11:32.868930 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.868907    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy" containerID="cri-o://28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521" gracePeriod=30
Nov 03 06:11:32.881961 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.881928    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"]
Nov 03 06:11:32.882205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.882181    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy" containerID="cri-o://5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a" gracePeriod=30
Nov 03 06:11:32.938425 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:32.938379    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:33.521958 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:33.521922    4418 patch_prober.go:29] interesting pod/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:33.522446 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:33.522001    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:33.605552 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:33.605522    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"]
Nov 03 06:11:33.605801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:33.605756    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg" podUID="44a72340-5c3a-4d83-8931-791031f1a896" containerName="maas-api" containerID="cri-o://b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317" gracePeriod=30
Nov 03 06:11:33.745411 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:33.745377    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:34.093576 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.093549    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:11:34.233936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.233846    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44a72340-5c3a-4d83-8931-791031f1a896-kube-api-access-9vfzm\" (UniqueName: \"kubernetes.io/projected/44a72340-5c3a-4d83-8931-791031f1a896-kube-api-access-9vfzm\") pod \"44a72340-5c3a-4d83-8931-791031f1a896\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") "
Nov 03 06:11:34.233936 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.233916    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-metrics-certs\") pod \"44a72340-5c3a-4d83-8931-791031f1a896\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") "
Nov 03 06:11:34.234145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.233945    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/44a72340-5c3a-4d83-8931-791031f1a896-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a72340-5c3a-4d83-8931-791031f1a896-openshift-service-ca\") pod \"44a72340-5c3a-4d83-8931-791031f1a896\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") "
Nov 03 06:11:34.234145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.234045    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-maas-api-tls\") pod \"44a72340-5c3a-4d83-8931-791031f1a896\" (UID: \"44a72340-5c3a-4d83-8931-791031f1a896\") "
Nov 03 06:11:34.234366 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.234331    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44a72340-5c3a-4d83-8931-791031f1a896-openshift-service-ca" pod "44a72340-5c3a-4d83-8931-791031f1a896" (UID: "44a72340-5c3a-4d83-8931-791031f1a896"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:34.234599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.234584    4418 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44a72340-5c3a-4d83-8931-791031f1a896-openshift-service-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:34.236181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.236161    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44a72340-5c3a-4d83-8931-791031f1a896-kube-api-access-9vfzm" pod "44a72340-5c3a-4d83-8931-791031f1a896" (UID: "44a72340-5c3a-4d83-8931-791031f1a896"). InnerVolumeSpecName "kube-api-access-9vfzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:34.236614 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.236591    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-metrics-certs" pod "44a72340-5c3a-4d83-8931-791031f1a896" (UID: "44a72340-5c3a-4d83-8931-791031f1a896"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:34.236677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.236620    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-maas-api-tls" pod "44a72340-5c3a-4d83-8931-791031f1a896" (UID: "44a72340-5c3a-4d83-8931-791031f1a896"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:11:34.335252 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.335211    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vfzm\" (UniqueName: \"kubernetes.io/projected/44a72340-5c3a-4d83-8931-791031f1a896-kube-api-access-9vfzm\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:34.335252 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.335246    4418 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-metrics-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:34.335252 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.335261    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44a72340-5c3a-4d83-8931-791031f1a896-maas-api-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:34.377251 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.377221    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:34.545135 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.545045    4418 generic.go:356] "Generic (PLEG): container finished" podID="44a72340-5c3a-4d83-8931-791031f1a896" containerID="b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317" exitCode=0
Nov 03 06:11:34.545135 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.545105    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"
Nov 03 06:11:34.545645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.545132    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg" event={"ID":"44a72340-5c3a-4d83-8931-791031f1a896","Type":"ContainerDied","Data":"b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317"}
Nov 03 06:11:34.545645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.545189    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg" event={"ID":"44a72340-5c3a-4d83-8931-791031f1a896","Type":"ContainerDied","Data":"e180d00b7fee75993560ff84e7d97b276e30a19097ce2280fde46ce914a05306"}
Nov 03 06:11:34.545645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.545213    4418 scope.go:122] "RemoveContainer" containerID="b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317"
Nov 03 06:11:34.555347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.555327    4418 scope.go:122] "RemoveContainer" containerID="b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317"
Nov 03 06:11:34.555688 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:34.555669    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317\": container with ID starting with b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317 not found: ID does not exist" containerID="b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317"
Nov 03 06:11:34.555743 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.555698    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317"} err="failed to get container status \"b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317\": rpc error: code = NotFound desc = could not find container \"b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317\": container with ID starting with b6537e6fbbe19ff7b7e3ca3806bfc5f4ac8645edcc1d1569c8a08c35bfe1d317 not found: ID does not exist"
Nov 03 06:11:34.563214 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.563191    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:34.600059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.600024    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"]
Nov 03 06:11:34.614042 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.613995    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-9688d8-6bdb66c8f9-gd6pg"]
Nov 03 06:11:34.783929 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:34.783888    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44a72340-5c3a-4d83-8931-791031f1a896" path="/var/lib/kubelet/pods/44a72340-5c3a-4d83-8931-791031f1a896/volumes"
Nov 03 06:11:35.088975 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:35.088929    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:38.147347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.147319    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:11:38.190887 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.190850    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:11:38.194115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.194093    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:11:38.286306 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286269    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-kube-api-access-2g248\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-kube-api-access-2g248\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.286529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286351    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-credential-socket\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.286529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286387    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37f4e51f-a45e-4546-b6b2-a760615f2da2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f4e51f-a45e-4546-b6b2-a760615f2da2-istiod-ca-cert\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.286529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286418    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-kube-api-access-l5m2z\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-kube-api-access-l5m2z\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.286529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286452    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-certs\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.286709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286547    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-token\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-token\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.286709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286576    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-socket\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.286709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286607    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-podinfo\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.286709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286637    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-envoy\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.286709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286677    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-token\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-token\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.286956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286716    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc0e000f-af9e-4fac-b314-169098cd5df9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0e000f-af9e-4fac-b314-169098cd5df9-istiod-ca-cert\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.286956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286749    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-istio-token\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-istio-token\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.286956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286778    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-socket\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.286956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286810    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-kube-api-access-h7pmn\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-kube-api-access-h7pmn\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.286956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286843    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-certs\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.286956 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.286888    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-credential-socket\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287385    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-data\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287432    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-envoy\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287469    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-certs\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287560    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9c671e07-7934-4c48-87d8-06979fa291eb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c671e07-7934-4c48-87d8-06979fa291eb-istio-podinfo\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287596    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-podinfo\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287626    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-socket\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287667    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-data\") pod \"37f4e51f-a45e-4546-b6b2-a760615f2da2\" (UID: \"37f4e51f-a45e-4546-b6b2-a760615f2da2\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287704    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c671e07-7934-4c48-87d8-06979fa291eb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c671e07-7934-4c48-87d8-06979fa291eb-istiod-ca-cert\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287728    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-credential-socket\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287778    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-data\") pod \"bc0e000f-af9e-4fac-b314-169098cd5df9\" (UID: \"bc0e000f-af9e-4fac-b314-169098cd5df9\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.287818    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-envoy\") pod \"9c671e07-7934-4c48-87d8-06979fa291eb\" (UID: \"9c671e07-7934-4c48-87d8-06979fa291eb\") "
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.288594    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-data" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.288603    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-credential-socket" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.288766    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-socket" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.289037    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-certs" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.289291    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-socket" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.289612    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c671e07-7934-4c48-87d8-06979fa291eb-istiod-ca-cert" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.289850    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-data" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.290037    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-credential-socket" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.290216    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-socket" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.291344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.291352    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-data" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.291755    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-certs" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.293782    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0e000f-af9e-4fac-b314-169098cd5df9-istiod-ca-cert" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.296493    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-istio-token" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.296900    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f4e51f-a45e-4546-b6b2-a760615f2da2-istiod-ca-cert" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.297443    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-kube-api-access-2g248" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "kube-api-access-2g248". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.297538    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-envoy" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.297653    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-credential-socket" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.298263    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-certs" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299169    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-token" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299294    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-kube-api-access-h7pmn" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "kube-api-access-h7pmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299380    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c671e07-7934-4c48-87d8-06979fa291eb-istio-podinfo" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299450    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-token" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299529    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-envoy" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299603    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-envoy" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299716    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-podinfo" pod "37f4e51f-a45e-4546-b6b2-a760615f2da2" (UID: "37f4e51f-a45e-4546-b6b2-a760615f2da2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.299757    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-kube-api-access-l5m2z" pod "9c671e07-7934-4c48-87d8-06979fa291eb" (UID: "9c671e07-7934-4c48-87d8-06979fa291eb"). InnerVolumeSpecName "kube-api-access-l5m2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:38.302696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.301376    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-podinfo" pod "bc0e000f-af9e-4fac-b314-169098cd5df9" (UID: "bc0e000f-af9e-4fac-b314-169098cd5df9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:38.389160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389079    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389119    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389134    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g248\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-kube-api-access-2g248\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389151    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389167    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37f4e51f-a45e-4546-b6b2-a760615f2da2-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389181    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5m2z\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-kube-api-access-l5m2z\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389194    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389207    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389219    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389231    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389245    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389258    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389271    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc0e000f-af9e-4fac-b314-169098cd5df9-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389283    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c671e07-7934-4c48-87d8-06979fa291eb-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389295    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389309    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7pmn\" (UniqueName: \"kubernetes.io/projected/37f4e51f-a45e-4546-b6b2-a760615f2da2-kube-api-access-h7pmn\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389322    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389334    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389347    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389358    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389371    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389383    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c671e07-7934-4c48-87d8-06979fa291eb-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.389393 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389394    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc0e000f-af9e-4fac-b314-169098cd5df9-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.390013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389407    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc0e000f-af9e-4fac-b314-169098cd5df9-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.390013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389420    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37f4e51f-a45e-4546-b6b2-a760615f2da2-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.390013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389434    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c671e07-7934-4c48-87d8-06979fa291eb-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.390013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.389446    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c671e07-7934-4c48-87d8-06979fa291eb-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:38.575587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.575551    4418 generic.go:356] "Generic (PLEG): container finished" podID="9c671e07-7934-4c48-87d8-06979fa291eb" containerID="28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521" exitCode=0
Nov 03 06:11:38.575781 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.575604    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"
Nov 03 06:11:38.575781 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.575631    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" event={"ID":"9c671e07-7934-4c48-87d8-06979fa291eb","Type":"ContainerDied","Data":"28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521"}
Nov 03 06:11:38.575781 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.575685    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d" event={"ID":"9c671e07-7934-4c48-87d8-06979fa291eb","Type":"ContainerDied","Data":"1cb8ac23c02de876a89fb858dd78eec9b55b452d7fae1e97a518d5a7e3d90b8a"}
Nov 03 06:11:38.575781 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.575717    4418 scope.go:122] "RemoveContainer" containerID="28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521"
Nov 03 06:11:38.577110 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.577094    4418 generic.go:356] "Generic (PLEG): container finished" podID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerID="5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a" exitCode=0
Nov 03 06:11:38.577190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.577146    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"
Nov 03 06:11:38.577190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.577185    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" event={"ID":"bc0e000f-af9e-4fac-b314-169098cd5df9","Type":"ContainerDied","Data":"5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a"}
Nov 03 06:11:38.577295 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.577220    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg" event={"ID":"bc0e000f-af9e-4fac-b314-169098cd5df9","Type":"ContainerDied","Data":"8cb84d03b2bb5b4fd565066d0cd5c51b9f1702ead912e4dfdfacbd418a9a4527"}
Nov 03 06:11:38.578599 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.578577    4418 generic.go:356] "Generic (PLEG): container finished" podID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerID="ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2" exitCode=0
Nov 03 06:11:38.578697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.578622    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"
Nov 03 06:11:38.578697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.578646    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" event={"ID":"37f4e51f-a45e-4546-b6b2-a760615f2da2","Type":"ContainerDied","Data":"ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2"}
Nov 03 06:11:38.578697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.578683    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh" event={"ID":"37f4e51f-a45e-4546-b6b2-a760615f2da2","Type":"ContainerDied","Data":"a4147e6c9243fffc21635bc4057dea7db31e3670c424af03a6e3f30c6b651b19"}
Nov 03 06:11:38.586228 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.586213    4418 scope.go:122] "RemoveContainer" containerID="28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521"
Nov 03 06:11:38.586605 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:38.586576    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521\": container with ID starting with 28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521 not found: ID does not exist" containerID="28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521"
Nov 03 06:11:38.586710 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.586618    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521"} err="failed to get container status \"28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521\": rpc error: code = NotFound desc = could not find container \"28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521\": container with ID starting with 28bf53bc6c0f273f0b737e3cfff3076d70242265a6535ccc6668f46f70c65521 not found: ID does not exist"
Nov 03 06:11:38.586710 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.586644    4418 scope.go:122] "RemoveContainer" containerID="5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a"
Nov 03 06:11:38.595872 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.595854    4418 scope.go:122] "RemoveContainer" containerID="5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a"
Nov 03 06:11:38.596142 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:38.596124    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a\": container with ID starting with 5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a not found: ID does not exist" containerID="5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a"
Nov 03 06:11:38.596187 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.596150    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a"} err="failed to get container status \"5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a\": rpc error: code = NotFound desc = could not find container \"5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a\": container with ID starting with 5c402504f582c5df1ff1eb0bb902911426b3f8c4c02a871c41a129e61a24380a not found: ID does not exist"
Nov 03 06:11:38.596187 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.596165    4418 scope.go:122] "RemoveContainer" containerID="ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2"
Nov 03 06:11:38.604347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.604329    4418 scope.go:122] "RemoveContainer" containerID="ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2"
Nov 03 06:11:38.604605 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:38.604586    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2\": container with ID starting with ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2 not found: ID does not exist" containerID="ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2"
Nov 03 06:11:38.604661 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.604611    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2"} err="failed to get container status \"ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2\": rpc error: code = NotFound desc = could not find container \"ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2\": container with ID starting with ebfe71532ba329a5bf42fc46c695ff19afe2fa79ef41cf5ba08bb0367ea6f7a2 not found: ID does not exist"
Nov 03 06:11:38.630449 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.630418    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"]
Nov 03 06:11:38.634801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.634774    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-695pg"]
Nov 03 06:11:38.677450 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.677378    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"]
Nov 03 06:11:38.685064 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.685037    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-c8x6d"]
Nov 03 06:11:38.739132 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.739095    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"]
Nov 03 06:11:38.743370 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.743344    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-5c3542-openshift-default-754655f44f-r6nzh"]
Nov 03 06:11:38.782332 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.782302    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" path="/var/lib/kubelet/pods/37f4e51f-a45e-4546-b6b2-a760615f2da2/volumes"
Nov 03 06:11:38.782852 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.782833    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" path="/var/lib/kubelet/pods/9c671e07-7934-4c48-87d8-06979fa291eb/volumes"
Nov 03 06:11:38.783282 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:38.783269    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" path="/var/lib/kubelet/pods/bc0e000f-af9e-4fac-b314-169098cd5df9/volumes"
Nov 03 06:11:40.930364 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:40.930307    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:11:41.016075 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.016041    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-kube-api-access-h8zff\" (UniqueName: \"kubernetes.io/projected/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-kube-api-access-h8zff\") pod \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") "
Nov 03 06:11:41.016247 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.016229    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-plugins-config-volume\") pod \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\" (UID: \"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7\") "
Nov 03 06:11:41.016629 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.016598    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-plugins-config-volume" pod "fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" (UID: "fd18b4fc-ebfc-40c2-be2a-43276a8eccd7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:41.018348 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.018325    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-kube-api-access-h8zff" pod "fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" (UID: "fd18b4fc-ebfc-40c2-be2a-43276a8eccd7"). InnerVolumeSpecName "kube-api-access-h8zff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:41.117601 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.117574    4418 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-plugins-config-volume\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:41.117601 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.117597    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8zff\" (UniqueName: \"kubernetes.io/projected/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7-kube-api-access-h8zff\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:41.599370 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.599335    4418 generic.go:356] "Generic (PLEG): container finished" podID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" containerID="86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0" exitCode=0
Nov 03 06:11:41.599551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.599387    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"
Nov 03 06:11:41.599551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.599420    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" event={"ID":"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7","Type":"ContainerDied","Data":"86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0"}
Nov 03 06:11:41.599551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.599478    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl" event={"ID":"fd18b4fc-ebfc-40c2-be2a-43276a8eccd7","Type":"ContainerDied","Data":"bbc64274d92b76c1ebeb157df585520fb1f21298f4e4dbab5ab4cb1b0e0b69ba"}
Nov 03 06:11:41.599551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.599520    4418 scope.go:122] "RemoveContainer" containerID="86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0"
Nov 03 06:11:41.612165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.612145    4418 scope.go:122] "RemoveContainer" containerID="86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0"
Nov 03 06:11:41.612610 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:41.612587    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0\": container with ID starting with 86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0 not found: ID does not exist" containerID="86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0"
Nov 03 06:11:41.612726 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.612618    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0"} err="failed to get container status \"86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0\": rpc error: code = NotFound desc = could not find container \"86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0\": container with ID starting with 86e9593f7498a242d805a90d99b4b70eeae76d9feeaee5e2a125b866e01fdfb0 not found: ID does not exist"
Nov 03 06:11:41.654109 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.654083    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"]
Nov 03 06:11:41.665785 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:41.665757    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-9688d8-6f57c65687-9tlnl"]
Nov 03 06:11:42.067643 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.067604    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:42.310147 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.310109    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:42.408080 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.408048    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"]
Nov 03 06:11:42.408338 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.408307    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy" containerID="cri-o://f76126853a953bf177f5f77ce65d91e75a2ab40c8f9434846aaf4df26317dde1" gracePeriod=30
Nov 03 06:11:42.443929 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.443898    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"]
Nov 03 06:11:42.444128 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.444105    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" containerID="cri-o://0cd9d323ac1b5fe9d84784715a637586aa6d8905ea506e450b9f5731bb7047cc" gracePeriod=30
Nov 03 06:11:42.447652 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.447625    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"]
Nov 03 06:11:42.447931 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.447902    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy" containerID="cri-o://6e9114cdc6aa90df6386875d069ee0987d79b57362676403e82059ba0f1ed519" gracePeriod=30
Nov 03 06:11:42.526700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.526583    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:42.784228 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:42.784143    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" path="/var/lib/kubelet/pods/fd18b4fc-ebfc-40c2-be2a-43276a8eccd7/volumes"
Nov 03 06:11:43.474381 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:43.474349    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:43.670978 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:43.670942    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:46.059512 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:46.059474    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:46.178613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:46.178578    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:46.178775 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:46.178636    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:47.251422 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.251388    4418 patch_prober.go:29] interesting pod/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 06:11:47.251829 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.251454    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 06:11:47.641979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.641740    4418 generic.go:356] "Generic (PLEG): container finished" podID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerID="f76126853a953bf177f5f77ce65d91e75a2ab40c8f9434846aaf4df26317dde1" exitCode=0
Nov 03 06:11:47.641979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.641904    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" event={"ID":"250ee13c-bd92-41b7-aa11-72ea0d25395b","Type":"ContainerDied","Data":"f76126853a953bf177f5f77ce65d91e75a2ab40c8f9434846aaf4df26317dde1"}
Nov 03 06:11:47.644573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.644364    4418 generic.go:356] "Generic (PLEG): container finished" podID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerID="6e9114cdc6aa90df6386875d069ee0987d79b57362676403e82059ba0f1ed519" exitCode=0
Nov 03 06:11:47.644573 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.644476    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" event={"ID":"5f243914-6e3e-419d-a81a-4330e1f24ae8","Type":"ContainerDied","Data":"6e9114cdc6aa90df6386875d069ee0987d79b57362676403e82059ba0f1ed519"}
Nov 03 06:11:47.646931 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.646862    4418 generic.go:356] "Generic (PLEG): container finished" podID="faccdd52-4e72-4255-94ad-f126db8baa72" containerID="0cd9d323ac1b5fe9d84784715a637586aa6d8905ea506e450b9f5731bb7047cc" exitCode=0
Nov 03 06:11:47.646931 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.646917    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" event={"ID":"faccdd52-4e72-4255-94ad-f126db8baa72","Type":"ContainerDied","Data":"0cd9d323ac1b5fe9d84784715a637586aa6d8905ea506e450b9f5731bb7047cc"}
Nov 03 06:11:47.785041 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.784454    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:11:47.788617 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.788596    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:11:47.878298 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.878212    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885154    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/faccdd52-4e72-4255-94ad-f126db8baa72-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faccdd52-4e72-4255-94ad-f126db8baa72-istio-podinfo\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885208    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-envoy\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885248    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-kube-api-access-nhn9k\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-kube-api-access-nhn9k\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885277    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-kube-api-access-24q8g\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-kube-api-access-24q8g\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885349    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-istio-token\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-istio-token\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885407    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-credential-socket\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885467    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-certs\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885496    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/250ee13c-bd92-41b7-aa11-72ea0d25395b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/250ee13c-bd92-41b7-aa11-72ea0d25395b-istiod-ca-cert\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885582    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-certs\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885701    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-socket\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885764    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-envoy\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885795    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-data\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885833    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-credential-socket\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885864    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-podinfo\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885900    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-token\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-token\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885938    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-data\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.885998    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-socket\") pod \"250ee13c-bd92-41b7-aa11-72ea0d25395b\" (UID: \"250ee13c-bd92-41b7-aa11-72ea0d25395b\") "
Nov 03 06:11:47.888336 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.886026    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/faccdd52-4e72-4255-94ad-f126db8baa72-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faccdd52-4e72-4255-94ad-f126db8baa72-istiod-ca-cert\") pod \"faccdd52-4e72-4255-94ad-f126db8baa72\" (UID: \"faccdd52-4e72-4255-94ad-f126db8baa72\") "
Nov 03 06:11:47.889933 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.889645    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faccdd52-4e72-4255-94ad-f126db8baa72-istiod-ca-cert" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:47.890286 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.890119    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-certs" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.890948 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.890644    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-socket" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.891475 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.891277    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-credential-socket" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.893555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.893270    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-data" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.893931 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.893912    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-data" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.894294 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.894273    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-socket" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.894677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.894657    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-certs" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.895038 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.895019    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-credential-socket" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.895562 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.895542    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/250ee13c-bd92-41b7-aa11-72ea0d25395b-istiod-ca-cert" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:47.900747 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.900715    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-kube-api-access-nhn9k" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "kube-api-access-nhn9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:47.901571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.901225    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-istio-token" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:47.901571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.901324    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-kube-api-access-24q8g" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "kube-api-access-24q8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:47.901571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.901397    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/faccdd52-4e72-4255-94ad-f126db8baa72-istio-podinfo" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:47.901571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.901459    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-envoy" pod "faccdd52-4e72-4255-94ad-f126db8baa72" (UID: "faccdd52-4e72-4255-94ad-f126db8baa72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.901571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.901546    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-podinfo" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:47.902459 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.902429    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-token" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:47.902615 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.902592    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-envoy" pod "250ee13c-bd92-41b7-aa11-72ea0d25395b" (UID: "250ee13c-bd92-41b7-aa11-72ea0d25395b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.986979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.986944    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-socket\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.986979 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.986980    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-data\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987016    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-podinfo\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987038    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-token\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-token\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987069    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-envoy\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987092    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-kube-api-access-qdgw4\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-kube-api-access-qdgw4\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987220 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987147    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f243914-6e3e-419d-a81a-4330e1f24ae8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f243914-6e3e-419d-a81a-4330e1f24ae8-istiod-ca-cert\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987227    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-certs\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987276    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-socket" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987291    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-data" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987306    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-credential-socket\") pod \"5f243914-6e3e-419d-a81a-4330e1f24ae8\" (UID: \"5f243914-6e3e-419d-a81a-4330e1f24ae8\") "
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987539    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-certs" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987636    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f243914-6e3e-419d-a81a-4330e1f24ae8-istiod-ca-cert" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987694    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987714    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faccdd52-4e72-4255-94ad-f126db8baa72-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987727    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faccdd52-4e72-4255-94ad-f126db8baa72-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987741    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987754    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhn9k\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-kube-api-access-nhn9k\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987757    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-credential-socket" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987768    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24q8g\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-kube-api-access-24q8g\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987782    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faccdd52-4e72-4255-94ad-f126db8baa72-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.987791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987799    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987814    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987827    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987839    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987851    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/250ee13c-bd92-41b7-aa11-72ea0d25395b-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987863    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987878    4418 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-workload-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987890    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987901    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987913    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/250ee13c-bd92-41b7-aa11-72ea0d25395b-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987926    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987939    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/250ee13c-bd92-41b7-aa11-72ea0d25395b-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987953    4418 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faccdd52-4e72-4255-94ad-f126db8baa72-istio-data\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.988442 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.987967    4418 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-workload-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:47.989809 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.989786    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-podinfo" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 06:11:47.989809 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.989801    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-envoy" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:11:47.989960 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.989823    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-token" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:47.990053 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:47.990039    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-kube-api-access-qdgw4" pod "5f243914-6e3e-419d-a81a-4330e1f24ae8" (UID: "5f243914-6e3e-419d-a81a-4330e1f24ae8"). InnerVolumeSpecName "kube-api-access-qdgw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:11:48.089059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.089027    4418 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-credential-socket\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:48.089059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.089053    4418 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-podinfo\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:48.089059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.089062    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:48.089271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.089072    4418 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f243914-6e3e-419d-a81a-4330e1f24ae8-istio-envoy\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:48.089271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.089080    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdgw4\" (UniqueName: \"kubernetes.io/projected/5f243914-6e3e-419d-a81a-4330e1f24ae8-kube-api-access-qdgw4\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:48.089271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.089089    4418 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f243914-6e3e-419d-a81a-4330e1f24ae8-istiod-ca-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:11:48.654167 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.654135    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"
Nov 03 06:11:48.654167 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.654148    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv" event={"ID":"faccdd52-4e72-4255-94ad-f126db8baa72","Type":"ContainerDied","Data":"eff3966da29379588ad2cb461e313af24434267ff5059463da3ab67eb28d8820"}
Nov 03 06:11:48.654697 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.654202    4418 scope.go:122] "RemoveContainer" containerID="0cd9d323ac1b5fe9d84784715a637586aa6d8905ea506e450b9f5731bb7047cc"
Nov 03 06:11:48.655768 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.655751    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"
Nov 03 06:11:48.655877 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.655849    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8" event={"ID":"250ee13c-bd92-41b7-aa11-72ea0d25395b","Type":"ContainerDied","Data":"1e1f49b23008b71da01789f914529bda1086bd2c5d7e839366db0222331b22e3"}
Nov 03 06:11:48.657479 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.657454    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q" event={"ID":"5f243914-6e3e-419d-a81a-4330e1f24ae8","Type":"ContainerDied","Data":"d73acaea2bfa8c14edc188f37f86e9de3269f1ace09d6e3af6a7e357bb7c1a0d"}
Nov 03 06:11:48.657605 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.657566    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"
Nov 03 06:11:48.664537 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.664492    4418 scope.go:122] "RemoveContainer" containerID="f76126853a953bf177f5f77ce65d91e75a2ab40c8f9434846aaf4df26317dde1"
Nov 03 06:11:48.674841 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.674826    4418 scope.go:122] "RemoveContainer" containerID="6e9114cdc6aa90df6386875d069ee0987d79b57362676403e82059ba0f1ed519"
Nov 03 06:11:48.718325 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.718275    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"]
Nov 03 06:11:48.729856 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.729830    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-7jkfv"]
Nov 03 06:11:48.758449 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.758420    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"]
Nov 03 06:11:48.762390 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.762368    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-nhrg8"]
Nov 03 06:11:48.784225 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.784204    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" path="/var/lib/kubelet/pods/250ee13c-bd92-41b7-aa11-72ea0d25395b/volumes"
Nov 03 06:11:48.784713 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.784695    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" path="/var/lib/kubelet/pods/faccdd52-4e72-4255-94ad-f126db8baa72/volumes"
Nov 03 06:11:48.803482 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.803453    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"]
Nov 03 06:11:48.811104 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:48.811079    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-9688d8-openshift-default-bf4df7489-6pz9q"]
Nov 03 06:11:49.099345 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:49.099253    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:49.269707 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:49.269676    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:49.433275 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:49.433242    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:50.784314 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:50.784272    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" path="/var/lib/kubelet/pods/5f243914-6e3e-419d-a81a-4330e1f24ae8/volumes"
Nov 03 06:11:52.643959 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:52.643856    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:55.400128 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:11:55.400096    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:11:58.404033 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:11:58.403988    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:12:00.036078 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:12:00.036038    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"]
Nov 03 06:12:00.047463 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:12:00.047437    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a2cad516-drw8m"]
Nov 03 06:12:00.781615 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:12:00.781589    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a" path="/var/lib/kubelet/pods/7f3bc2d1-2fb5-4239-a7b3-0689c8af2f2a/volumes"
Nov 03 06:12:05.211468 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:12:05.211421    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:12:19.875020 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:12:19.874988    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:12:21.558256 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:12:21.558218    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:12:28.404529 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:12:28.404426    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:12:52.288571 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:12:52.288528    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:12:58.403945 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:12:58.403909    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:13:05.302015 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:13:05.301980    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:13:13.392551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:13:13.392495    4418 scope.go:122] "RemoveContainer" containerID="0cf158897996253b2d86b6acc4c0e2bd0b91edda599063dc28594df6550772de"
Nov 03 06:13:25.763640 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:13:25.763605    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:13:25.764043 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:13:25.763683    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:13:28.057706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:13:28.057671    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:13:28.256361 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:13:28.256331    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:13:28.404347 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:13:28.404310    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:13:33.018780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:13:33.018738    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:13:58.408219 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:13:58.408138    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:14:05.423639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:14:05.423603    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:14:28.404414 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:14:28.404376    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:14:58.408355 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:14:58.408293    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:14:59.030811 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:14:59.030777    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"]
Nov 03 06:14:59.042198 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:14:59.042152    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-276e0608-tmb89"]
Nov 03 06:15:00.821526 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:00.813214    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d84786e-97c9-44b3-bbc7-bcb70c641534" path="/var/lib/kubelet/pods/6d84786e-97c9-44b3-bbc7-bcb70c641534/volumes"
Nov 03 06:15:05.549836 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.549796    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:15:05.960866 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.960832    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"]
Nov 03 06:15:05.961221 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961210    4418 cpu_manager.go:414] "containerMap: removing container" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy"
Nov 03 06:15:05.961271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961223    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy"
Nov 03 06:15:05.961271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961234    4418 cpu_manager.go:414] "containerMap: removing container" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy"
Nov 03 06:15:05.961271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961239    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy"
Nov 03 06:15:05.961271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961249    4418 cpu_manager.go:414] "containerMap: removing container" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy"
Nov 03 06:15:05.961271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961256    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy"
Nov 03 06:15:05.961271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961267    4418 cpu_manager.go:414] "containerMap: removing container" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy"
Nov 03 06:15:05.961271 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961272    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961278    4418 cpu_manager.go:414] "containerMap: removing container" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961282    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961287    4418 cpu_manager.go:414] "containerMap: removing container" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961294    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961304    4418 cpu_manager.go:414] "containerMap: removing container" podUID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" containerName="payload-pre-processing"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961308    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" containerName="payload-pre-processing"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961318    4418 cpu_manager.go:414] "containerMap: removing container" podUID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" containerName="payload-pre-processing"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961323    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" containerName="payload-pre-processing"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961330    4418 cpu_manager.go:414] "containerMap: removing container" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961334    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961343    4418 cpu_manager.go:414] "containerMap: removing container" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961347    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961355    4418 cpu_manager.go:414] "containerMap: removing container" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961360    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961366    4418 cpu_manager.go:414] "containerMap: removing container" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961370    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961376    4418 cpu_manager.go:414] "containerMap: removing container" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961380    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961390    4418 cpu_manager.go:414] "containerMap: removing container" podUID="538fb4be-1740-4814-b31e-ca5fdc22b819" containerName="payload-processing"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961394    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="538fb4be-1740-4814-b31e-ca5fdc22b819" containerName="payload-processing"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961400    4418 cpu_manager.go:414] "containerMap: removing container" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961405    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961410    4418 cpu_manager.go:414] "containerMap: removing container" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961415    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961420    4418 cpu_manager.go:414] "containerMap: removing container" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961424    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961432    4418 cpu_manager.go:414] "containerMap: removing container" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961436    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961446    4418 cpu_manager.go:414] "containerMap: removing container" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961450    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961456    4418 cpu_manager.go:414] "containerMap: removing container" podUID="15ae3cf1-f453-4368-8843-fec7d202cdbe" containerName="revoke-keys"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961460    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15ae3cf1-f453-4368-8843-fec7d202cdbe" containerName="revoke-keys"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961466    4418 cpu_manager.go:414] "containerMap: removing container" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961471    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961477    4418 cpu_manager.go:414] "containerMap: removing container" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961481    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961490    4418 cpu_manager.go:414] "containerMap: removing container" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main"
Nov 03 06:15:05.961481 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961495    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961518    4418 cpu_manager.go:414] "containerMap: removing container" podUID="44a72340-5c3a-4d83-8931-791031f1a896" containerName="maas-api"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961526    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44a72340-5c3a-4d83-8931-791031f1a896" containerName="maas-api"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961532    4418 cpu_manager.go:414] "containerMap: removing container" podUID="fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" containerName="maas-api"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961537    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" containerName="maas-api"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961544    4418 cpu_manager.go:414] "containerMap: removing container" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961548    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961555    4418 cpu_manager.go:414] "containerMap: removing container" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961559    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961566    4418 cpu_manager.go:414] "containerMap: removing container" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961571    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961577    4418 cpu_manager.go:414] "containerMap: removing container" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961581    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961654    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="90ff3960-8e55-4cc1-920c-ca62c7e76e16" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961661    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="be0a6235-7bfe-408f-a725-3e17537ea9ab" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961668    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd18b4fc-ebfc-40c2-be2a-43276a8eccd7" containerName="payload-pre-processing"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961674    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbde71a0-af0e-4cfb-af11-b3cc1fef02b0" containerName="payload-pre-processing"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961680    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7a93263-1fc0-4249-a4c4-7dac8a90af34" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961686    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="29019981-1664-4c52-bc0a-784c8061b931" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961691    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="250ee13c-bd92-41b7-aa11-72ea0d25395b" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961696    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="37f4e51f-a45e-4546-b6b2-a760615f2da2" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961702    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="84e6cf40-6ada-41c2-b797-c62c74c1c862" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961708    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="538fb4be-1740-4814-b31e-ca5fdc22b819" containerName="payload-processing"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961712    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="295cd236-273a-41d4-b1ce-be6d1690a33c" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961717    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="c341b7fe-42a9-470a-9802-b813b1dc688d" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961722    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="573ba103-e498-42ed-bbf5-26cb9a559f87" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961727    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="7353a86e-334f-40f0-ab22-a1c837591d17" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961732    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="840055d2-ee63-4220-9fa1-536a5bd7fde4" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961737    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="15ae3cf1-f453-4368-8843-fec7d202cdbe" containerName="revoke-keys"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961742    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="66151bde-baff-4252-849b-9a70cdcb4aec" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961747    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f243914-6e3e-419d-a81a-4330e1f24ae8" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961752    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f0caac6-1354-4401-9713-3cf60f31487f" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961758    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="44a72340-5c3a-4d83-8931-791031f1a896" containerName="maas-api"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961762    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc4d463b-5e13-4b00-ba7c-de31ca33d4d7" containerName="maas-api"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961767    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f5dad80-945c-4941-81a9-94367d37de44" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961773    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="6019bcd0-2450-4042-ab89-10c5e8f43379" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961778    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="84bf9f7a-e132-446b-a527-a69f8885aceb" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961782    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="776dbac9-7c0a-47b2-a2b4-eaf723467109" containerName="main"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961787    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c671e07-7934-4c48-87d8-06979fa291eb" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961793    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc0e000f-af9e-4fac-b314-169098cd5df9" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961798    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7b4ea53-0f14-4371-807d-809bb5d5b956" containerName="istio-proxy"
Nov 03 06:15:05.962965 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.961802    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="faccdd52-4e72-4255-94ad-f126db8baa72" containerName="istio-proxy"
Nov 03 06:15:05.964847 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.964831    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:05.979187 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.979166    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 06:15:05.990993 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.990971    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rxh5n\""
Nov 03 06:15:05.993937 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:05.993912    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"]
Nov 03 06:15:06.082751 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.082719    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.082959 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.082780    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmdd\" (UniqueName: \"kubernetes.io/projected/db18cd1e-e9de-43ad-99ed-584652e28dce-kube-api-access-zrmdd\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.082959 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.082927    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.183989 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.183961    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.184115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.184011    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmdd\" (UniqueName: \"kubernetes.io/projected/db18cd1e-e9de-43ad-99ed-584652e28dce-kube-api-access-zrmdd\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.184115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.184048    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.184707 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.184689    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.186185 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.186166    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.206417 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.206392    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmdd\" (UniqueName: \"kubernetes.io/projected/db18cd1e-e9de-43ad-99ed-584652e28dce-kube-api-access-zrmdd\") pod \"maas-api-revoke-sub-a4aef7d7-nljnr\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.277166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.277115    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:06.569990 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.569966    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"]
Nov 03 06:15:06.571971 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:15:06.571942    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb18cd1e_e9de_43ad_99ed_584652e28dce.slice/crio-fc90240501d2572f46a4a065b546d2c863f1f0d74e30b92a271d06c416511327 WatchSource:0}: Error finding container fc90240501d2572f46a4a065b546d2c863f1f0d74e30b92a271d06c416511327: Status 404 returned error can't find the container with id fc90240501d2572f46a4a065b546d2c863f1f0d74e30b92a271d06c416511327
Nov 03 06:15:06.698999 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:06.698972    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr" event={"ID":"db18cd1e-e9de-43ad-99ed-584652e28dce","Type":"ContainerStarted","Data":"fc90240501d2572f46a4a065b546d2c863f1f0d74e30b92a271d06c416511327"}
Nov 03 06:15:07.707759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:07.707680    4418 generic.go:356] "Generic (PLEG): container finished" podID="db18cd1e-e9de-43ad-99ed-584652e28dce" containerID="dcef194085d4cc0276c325d8eb345e455eb54642c18992f229382ea642a2a7d4" exitCode=0
Nov 03 06:15:07.707759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:07.707719    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr" event={"ID":"db18cd1e-e9de-43ad-99ed-584652e28dce","Type":"ContainerDied","Data":"dcef194085d4cc0276c325d8eb345e455eb54642c18992f229382ea642a2a7d4"}
Nov 03 06:15:08.846279 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:08.846255    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:08.909322 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:08.909293    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-xks-ca\") pod \"db18cd1e-e9de-43ad-99ed-584652e28dce\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") "
Nov 03 06:15:08.909485 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:08.909408    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db18cd1e-e9de-43ad-99ed-584652e28dce-kube-api-access-zrmdd\" (UniqueName: \"kubernetes.io/projected/db18cd1e-e9de-43ad-99ed-584652e28dce-kube-api-access-zrmdd\") pod \"db18cd1e-e9de-43ad-99ed-584652e28dce\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") "
Nov 03 06:15:08.909485 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:08.909449    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-openshift-ca\") pod \"db18cd1e-e9de-43ad-99ed-584652e28dce\" (UID: \"db18cd1e-e9de-43ad-99ed-584652e28dce\") "
Nov 03 06:15:08.909856 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:08.909825    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-openshift-ca" pod "db18cd1e-e9de-43ad-99ed-584652e28dce" (UID: "db18cd1e-e9de-43ad-99ed-584652e28dce"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:15:08.911485 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:08.911457    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db18cd1e-e9de-43ad-99ed-584652e28dce-kube-api-access-zrmdd" pod "db18cd1e-e9de-43ad-99ed-584652e28dce" (UID: "db18cd1e-e9de-43ad-99ed-584652e28dce"). InnerVolumeSpecName "kube-api-access-zrmdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:15:08.911770 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:08.911753    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-xks-ca" pod "db18cd1e-e9de-43ad-99ed-584652e28dce" (UID: "db18cd1e-e9de-43ad-99ed-584652e28dce"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:15:09.010434 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:09.010379    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-openshift-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:15:09.010434 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:09.010401    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db18cd1e-e9de-43ad-99ed-584652e28dce-maas-api-xks-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:15:09.010434 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:09.010410    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrmdd\" (UniqueName: \"kubernetes.io/projected/db18cd1e-e9de-43ad-99ed-584652e28dce-kube-api-access-zrmdd\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:15:09.719160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:09.719127    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr" event={"ID":"db18cd1e-e9de-43ad-99ed-584652e28dce","Type":"ContainerDied","Data":"fc90240501d2572f46a4a065b546d2c863f1f0d74e30b92a271d06c416511327"}
Nov 03 06:15:09.719160 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:09.719159    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"
Nov 03 06:15:09.719381 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:09.719175    4418 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc90240501d2572f46a4a065b546d2c863f1f0d74e30b92a271d06c416511327"
Nov 03 06:15:28.404527 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:15:28.404432    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:15:29.033203 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:29.033172    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"]
Nov 03 06:15:29.044941 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:29.044913    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-af4454f2-r8dbz"]
Nov 03 06:15:30.782287 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:30.782250    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cce7fc8f-9aad-4cf1-9a49-bf91bcab9811" path="/var/lib/kubelet/pods/cce7fc8f-9aad-4cf1-9a49-bf91bcab9811/volumes"
Nov 03 06:15:42.027518 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:42.027480    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"]
Nov 03 06:15:42.039278 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:42.039251    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-60b851a1-28cgn"]
Nov 03 06:15:42.788874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:42.788837    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8d005559-722f-4a24-ab66-6a8ff953670a" path="/var/lib/kubelet/pods/8d005559-722f-4a24-ab66-6a8ff953670a/volumes"
Nov 03 06:15:44.032905 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:44.032871    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"]
Nov 03 06:15:44.045561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:44.045531    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dace93a1-7hshs"]
Nov 03 06:15:44.811533 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:44.811347    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4dfb08b1-180a-4100-8197-65c5431343f6" path="/var/lib/kubelet/pods/4dfb08b1-180a-4100-8197-65c5431343f6/volumes"
Nov 03 06:15:58.404810 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:15:58.404773    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:15:59.027051 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:59.027012    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"]
Nov 03 06:15:59.038809 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:15:59.038784    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-42cb49ea-gchds"]
Nov 03 06:16:00.781387 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:00.781356    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15ae3cf1-f453-4368-8843-fec7d202cdbe" path="/var/lib/kubelet/pods/15ae3cf1-f453-4368-8843-fec7d202cdbe/volumes"
Nov 03 06:16:05.621068 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:05.621030    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:16:13.439543 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:13.435729    4418 scope.go:122] "RemoveContainer" containerID="a28b6babd7160ed5fb1ae47e6a9d6cf79a255d7aec23cf339fd275ed3b834f2f"
Nov 03 06:16:21.847802 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:21.847760    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:16:28.403922 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:16:28.403885    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:16:31.435552 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:31.435519    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:16:34.587812 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.587775    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"]
Nov 03 06:16:34.588319 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.588073    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" podUID="df3f86e1-33c5-4182-abda-5283257591b6" containerName="discovery" containerID="cri-o://c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e" gracePeriod=30
Nov 03 06:16:34.836096 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.836072    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:16:34.972305 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972279    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-ca-configmap\") pod \"df3f86e1-33c5-4182-abda-5283257591b6\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") "
Nov 03 06:16:34.972494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972324    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df3f86e1-33c5-4182-abda-5283257591b6-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f86e1-33c5-4182-abda-5283257591b6-local-certs\") pod \"df3f86e1-33c5-4182-abda-5283257591b6\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") "
Nov 03 06:16:34.972494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972364    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-kubeconfig\") pod \"df3f86e1-33c5-4182-abda-5283257591b6\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") "
Nov 03 06:16:34.972494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972397    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-dns-cert\") pod \"df3f86e1-33c5-4182-abda-5283257591b6\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") "
Nov 03 06:16:34.972494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972416    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-kube-api-access-gf7nz\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-kube-api-access-gf7nz\") pod \"df3f86e1-33c5-4182-abda-5283257591b6\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") "
Nov 03 06:16:34.972494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972456    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-istio-token\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-istio-token\") pod \"df3f86e1-33c5-4182-abda-5283257591b6\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") "
Nov 03 06:16:34.972494 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972483    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-cacerts\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-cacerts\") pod \"df3f86e1-33c5-4182-abda-5283257591b6\" (UID: \"df3f86e1-33c5-4182-abda-5283257591b6\") "
Nov 03 06:16:34.972847 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.972768    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-ca-configmap" pod "df3f86e1-33c5-4182-abda-5283257591b6" (UID: "df3f86e1-33c5-4182-abda-5283257591b6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:16:34.974657 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.974620    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df3f86e1-33c5-4182-abda-5283257591b6-local-certs" pod "df3f86e1-33c5-4182-abda-5283257591b6" (UID: "df3f86e1-33c5-4182-abda-5283257591b6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 06:16:34.974780 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.974710    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-kubeconfig" pod "df3f86e1-33c5-4182-abda-5283257591b6" (UID: "df3f86e1-33c5-4182-abda-5283257591b6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:16:34.975070 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.975047    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-cacerts" pod "df3f86e1-33c5-4182-abda-5283257591b6" (UID: "df3f86e1-33c5-4182-abda-5283257591b6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:16:34.975176 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.975147    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-kube-api-access-gf7nz" pod "df3f86e1-33c5-4182-abda-5283257591b6" (UID: "df3f86e1-33c5-4182-abda-5283257591b6"). InnerVolumeSpecName "kube-api-access-gf7nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:16:34.975243 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.975175    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-istio-token" pod "df3f86e1-33c5-4182-abda-5283257591b6" (UID: "df3f86e1-33c5-4182-abda-5283257591b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:16:34.975243 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:34.975214    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-dns-cert" pod "df3f86e1-33c5-4182-abda-5283257591b6" (UID: "df3f86e1-33c5-4182-abda-5283257591b6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:16:35.074132 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.074083    4418 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df3f86e1-33c5-4182-abda-5283257591b6-local-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:16:35.074132 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.074129    4418 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-kubeconfig\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:16:35.074132 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.074143    4418 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-dns-cert\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:16:35.074383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.074157    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf7nz\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-kube-api-access-gf7nz\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:16:35.074383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.074170    4418 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df3f86e1-33c5-4182-abda-5283257591b6-istio-token\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:16:35.074383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.074182    4418 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df3f86e1-33c5-4182-abda-5283257591b6-cacerts\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:16:35.074383 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.074192    4418 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df3f86e1-33c5-4182-abda-5283257591b6-istio-csr-ca-configmap\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:16:35.215583 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.215550    4418 generic.go:356] "Generic (PLEG): container finished" podID="df3f86e1-33c5-4182-abda-5283257591b6" containerID="c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e" exitCode=0
Nov 03 06:16:35.215763 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.215597    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"
Nov 03 06:16:35.215763 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.215637    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" event={"ID":"df3f86e1-33c5-4182-abda-5283257591b6","Type":"ContainerDied","Data":"c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e"}
Nov 03 06:16:35.215763 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.215693    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc" event={"ID":"df3f86e1-33c5-4182-abda-5283257591b6","Type":"ContainerDied","Data":"d18fe875b5a63ef8ac3b85e690770f86a294b1751312d74e8d141e49a9806a6d"}
Nov 03 06:16:35.215763 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.215720    4418 scope.go:122] "RemoveContainer" containerID="c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e"
Nov 03 06:16:35.224857 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.224838    4418 scope.go:122] "RemoveContainer" containerID="c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e"
Nov 03 06:16:35.225103 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:16:35.225084    4418 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e\": container with ID starting with c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e not found: ID does not exist" containerID="c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e"
Nov 03 06:16:35.225181 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.225110    4418 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e"} err="failed to get container status \"c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e\": rpc error: code = NotFound desc = could not find container \"c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e\": container with ID starting with c0124323780ea69c7bfe18c2f883bdb1cbef77bad94439c723cbcb9d5615734e not found: ID does not exist"
Nov 03 06:16:35.266413 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.266393    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"]
Nov 03 06:16:35.278436 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:35.278417    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-ltgsc"]
Nov 03 06:16:36.782124 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:36.782089    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df3f86e1-33c5-4182-abda-5283257591b6" path="/var/lib/kubelet/pods/df3f86e1-33c5-4182-abda-5283257591b6/volumes"
Nov 03 06:16:55.765683 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:55.765611    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-ngjk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:16:55.765683 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:16:55.765662    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-ngjk2" podUID="ef10258e-5fcc-4d6c-ba91-f31997a227ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:16:58.403946 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:16:58.403908    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:17:05.796563 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:05.796534    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:13.466161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:13.466127    4418 scope.go:122] "RemoveContainer" containerID="7f2f85166d542204f412676e670bed237bde6eee3ea368626db17f19cc9b4a25"
Nov 03 06:17:13.492542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:13.489658    4418 scope.go:122] "RemoveContainer" containerID="36fd508fe5bac752aacef45b9c489dadbc5ca6e4203f3937ae88268f5cf97b4a"
Nov 03 06:17:13.546633 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:13.543617    4418 scope.go:122] "RemoveContainer" containerID="493ea7d3eddcc7b5865ee8ce925bc2fb27a4bfe4e92b3a4bd35fed624f7eeb97"
Nov 03 06:17:13.557880 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:13.557858    4418 scope.go:122] "RemoveContainer" containerID="e729f2c0a6ee4e2262277d863b4e72a3485972c10abf8945374882c15fda7529"
Nov 03 06:17:28.404675 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:17:28.404636    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:17:49.900118 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:49.900078    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:50.379034 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:50.378993    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:50.565868 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:50.565839    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:53.555067 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:53.555034    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:53.727722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:53.727687    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:55.116182 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:55.116155    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:55.281258 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:55.281222    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:55.448773 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:55.448704    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:57.075046 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:57.074997    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:17:58.404796 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:17:58.404757    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:17:59.108804 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:17:59.108766    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:00.881669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:00.881633    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:02.764839 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:02.764802    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:04.649860 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:04.649821    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:05.919028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:05.918984    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:06.460066 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:06.460030    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:08.141296 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:08.141257    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:08.409382 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:08.409287    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:09.024963 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:09.024917    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:09.235374 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:09.235338    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:09.996361 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:09.996328    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:10.865709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:10.865672    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:11.899227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:11.899195    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:13.860115 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:13.860074    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:15.639081 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:15.639037    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:17.450790 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:17.450759    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:19.243281 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:19.243251    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:21.158419 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:21.158386    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:22.840883 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:22.840839    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:24.181888 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:24.181855    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:24.351753 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:24.351718    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:24.548489 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:24.548405    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:26.247709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:26.247614    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:28.058929 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:28.058896    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:28.404625 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:18:28.404589    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:18:29.897209 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:29.897173    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:31.658937 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:31.658900    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:33.348887 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:33.348851    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:35.177005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:35.176968    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:36.864458 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:36.864418    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:38.643011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:38.642974    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:40.449353 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:40.449320    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:42.249765 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:42.249730    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:44.034752 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:44.034719    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:45.932043 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:45.932004    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:47.600083 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:47.600042    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:49.347704 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:49.347671    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:53.554997 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:53.554967    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:53.732656 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:53.732621    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:53.914119 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:53.914085    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:54.563816 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:54.563776    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:56.558587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:56.558555    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:58.404957 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:18:58.404917    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:18:58.476328 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:58.476281    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:58.936848 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:58.936818    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:59.801313 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:59.801283    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:18:59.994335 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:18:59.994296    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:00.277478 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:00.277447    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:02.051644 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:02.051607    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:03.903262 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:03.903222    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:04.713722 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:04.713688    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:04.888174 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:04.888141    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:05.713899 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:05.713869    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:06.068426 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:06.068333    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:06.291460 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:06.291428    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:06.467715 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:06.467677    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:07.180073 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:07.180030    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:07.710178 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:07.710140    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:07.890356 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:07.890316    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:08.369542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:08.369493    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:15.003127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:15.003094    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:15.256249 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:15.256148    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:15.445226 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:15.445193    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:28.404783 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:19:28.404748    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:19:34.221614 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:34.221566    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:35.977587 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:35.977552    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:36.772677 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:36.772641    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:42.692183 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:19:42.692143    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:19:58.403863 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:19:58.403829    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:20:06.182121 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:20:06.182082    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:20:06.350561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:20:06.350527    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:20:09.031211 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:20:09.031176    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"]
Nov 03 06:20:09.041721 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:20:09.041694    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-nljnr"]
Nov 03 06:20:10.781420 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:20:10.781390    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db18cd1e-e9de-43ad-99ed-584652e28dce" path="/var/lib/kubelet/pods/db18cd1e-e9de-43ad-99ed-584652e28dce/volumes"
Nov 03 06:20:28.403746 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:20:28.403711    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:20:58.404601 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:20:58.404559    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:21:06.312675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:06.312642    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:13.688408 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:13.688374    4418 scope.go:122] "RemoveContainer" containerID="dcef194085d4cc0276c325d8eb345e455eb54642c18992f229382ea642a2a7d4"
Nov 03 06:21:28.404611 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:21:28.404537    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:21:39.233078 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:39.233044    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:39.725040 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:39.725007    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:39.983353 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:39.983263    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:43.918195 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:43.918123    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:44.099179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:44.099139    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:45.466725 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:45.466688    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:45.644076 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:45.644042    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:47.440893 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:47.440859    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:49.156129 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:49.156091    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:50.988045 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:50.988007    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:52.972059 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:52.972025    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:54.866086 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:54.866050    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:56.823958 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:56.823915    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:58.404946 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:21:58.404913    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:21:58.453071 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:58.453028    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:58.692042 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:58.691959    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:59.297318 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:59.297284    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:21:59.486028 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:21:59.485996    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:00.413874 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:00.413836    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:01.424547 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:01.424513    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:02.276368 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:02.276333    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:04.116395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:04.116357    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:05.948848 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:05.948809    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:06.429820 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:06.429783    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:07.820343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:07.820300    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:08.799118 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:08.799079    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:09.527288 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:09.527254    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:11.241069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:11.241041    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:12.939247 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:12.939214    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:14.641176 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:14.641137    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:16.442972 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:16.442931    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:18.243205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:18.243165    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:20.056848 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:20.056811    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:21.876892 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:21.876850    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:23.639735 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:23.639684    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:25.347645 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:25.347602    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:27.053733 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:27.053698    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:28.404890 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:22:28.404850    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:22:28.759710 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:28.759608    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:30.632119 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:30.632087    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:32.349199 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:32.349164    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:34.058798 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:34.058764    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:35.853550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:35.853512    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:37.555858 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:37.555830    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:39.253859 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:39.253819    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:40.928110 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:40.928077    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:42.739090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:42.739053    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:44.260116 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:44.260079    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:44.467161 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:44.467120    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:46.359834 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:46.359801    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:48.045172 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:48.045139    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:49.383354 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:49.383309    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:49.767090 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:49.766993    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:51.440396 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:51.440361    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:53.145008 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:53.144971    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:54.840853 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:54.840813    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:55.092823 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:55.092736    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:55.268152 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:55.268121    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:56.377701 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:56.377604    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:56.897896 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:56.897860    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:57.079374 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:57.079346    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:57.555243 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:22:57.555188    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:22:58.403887 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:22:58.403853    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:23:02.096013 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:02.095959    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:02.256112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:02.256082    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:03.595033 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:03.594984    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:03.762355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:03.762321    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:03.955690 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:03.955647    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:06.563953 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:06.563917    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:08.603767 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:08.603736    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:24.892121 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:24.892073    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:26.590929 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:26.590898    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:26.966969 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:26.966925    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:28.408339 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:23:28.408298    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:23:41.681140 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:23:41.681103    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:23:58.403678 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:23:58.403640    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:24:00.935229 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:00.935196    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:02.977205 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:02.977165    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:05.941663 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:05.941618    4418 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-778b7b5c47-bgxkm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 06:24:05.942184 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:05.941712    4418 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-778b7b5c47-bgxkm" podUID="60dd6d76-b7cd-40ed-aa14-e5c637969321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 06:24:06.684775 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:06.684737    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:13.480024 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:13.479990    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:13.646624 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:13.646595    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:28.403752 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:24:28.403669    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:24:42.714825 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.714792    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"]
Nov 03 06:24:42.715547 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.715522    4418 cpu_manager.go:414] "containerMap: removing container" podUID="db18cd1e-e9de-43ad-99ed-584652e28dce" containerName="revoke-keys"
Nov 03 06:24:42.715678 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.715549    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db18cd1e-e9de-43ad-99ed-584652e28dce" containerName="revoke-keys"
Nov 03 06:24:42.715678 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.715586    4418 cpu_manager.go:414] "containerMap: removing container" podUID="df3f86e1-33c5-4182-abda-5283257591b6" containerName="discovery"
Nov 03 06:24:42.715678 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.715594    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df3f86e1-33c5-4182-abda-5283257591b6" containerName="discovery"
Nov 03 06:24:42.715834 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.715704    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="df3f86e1-33c5-4182-abda-5283257591b6" containerName="discovery"
Nov 03 06:24:42.715834 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.715723    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="db18cd1e-e9de-43ad-99ed-584652e28dce" containerName="revoke-keys"
Nov 03 06:24:42.719156 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.719135    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:42.749427 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.749405    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 03 06:24:42.749572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.749493    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 03 06:24:42.749572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.749552    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k6kkr\""
Nov 03 06:24:42.761554 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.758558    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"]
Nov 03 06:24:42.901881 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.901847    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-metrics-certs\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:42.901881 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.901879    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdxc\" (UniqueName: \"kubernetes.io/projected/27553feb-e9c9-4527-8ad3-ee4229ee14ad-kube-api-access-xkdxc\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:42.902137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.901910    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-maas-api-tls\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:42.902137 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:42.902034    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27553feb-e9c9-4527-8ad3-ee4229ee14ad-openshift-service-ca\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.002975 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.002893    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27553feb-e9c9-4527-8ad3-ee4229ee14ad-openshift-service-ca\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.003145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.003020    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-metrics-certs\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.003145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.003047    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdxc\" (UniqueName: \"kubernetes.io/projected/27553feb-e9c9-4527-8ad3-ee4229ee14ad-kube-api-access-xkdxc\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.003145 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.003087    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-maas-api-tls\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.003719 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.003692    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27553feb-e9c9-4527-8ad3-ee4229ee14ad-openshift-service-ca\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.005542 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.005524    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-maas-api-tls\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.005635 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.005582    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-metrics-certs\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.025709 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.025687    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdxc\" (UniqueName: \"kubernetes.io/projected/27553feb-e9c9-4527-8ad3-ee4229ee14ad-kube-api-access-xkdxc\") pod \"maas-api-6fd5d8948d-rm52x\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") " pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.032488 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.032467    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:43.327554 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.327436    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"]
Nov 03 06:24:43.330603 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:24:43.330576    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27553feb_e9c9_4527_8ad3_ee4229ee14ad.slice/crio-2a9fb951eb67cec50b0e95c4092f7a699df3550cc886817bef47b6df7bf24cdb WatchSource:0}: Error finding container 2a9fb951eb67cec50b0e95c4092f7a699df3550cc886817bef47b6df7bf24cdb: Status 404 returned error can't find the container with id 2a9fb951eb67cec50b0e95c4092f7a699df3550cc886817bef47b6df7bf24cdb
Nov 03 06:24:43.331815 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.331794    4418 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 06:24:43.539374 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:43.539339    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x" event={"ID":"27553feb-e9c9-4527-8ad3-ee4229ee14ad","Type":"ContainerStarted","Data":"2a9fb951eb67cec50b0e95c4092f7a699df3550cc886817bef47b6df7bf24cdb"}
Nov 03 06:24:44.545168 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:44.545137    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x" event={"ID":"27553feb-e9c9-4527-8ad3-ee4229ee14ad","Type":"ContainerStarted","Data":"6bd82664c2a3b597f9c33837265279bdbb1c11e287030eaa7b2198f65dd2f32a"}
Nov 03 06:24:44.545572 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:44.545259    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:44.587522 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:44.587450    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x" podStartSLOduration=2.173910566 podStartE2EDuration="2.587436836s" totalImagesPullingTime="413.52627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:24:44.586000206 +0000 UTC m=+1771.955950290" watchObservedRunningTime="2026-11-03 06:24:44.587436836 +0000 UTC m=+1771.957386920"
Nov 03 06:24:49.510298 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:49.510266    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:49.981849 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:49.981813    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:50.154166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.154131    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:50.395579 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.395544    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"]
Nov 03 06:24:50.395811 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.395760    4418 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x" podUID="27553feb-e9c9-4527-8ad3-ee4229ee14ad" containerName="maas-api" containerID="cri-o://6bd82664c2a3b597f9c33837265279bdbb1c11e287030eaa7b2198f65dd2f32a" gracePeriod=30
Nov 03 06:24:50.401355 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.401330    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:50.430794 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.430766    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-687bf79496-gcks8"]
Nov 03 06:24:50.434179 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.434163    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.458492 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.458467    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-687bf79496-gcks8"]
Nov 03 06:24:50.471609 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.471587    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-openshift-service-ca\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.471738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.471615    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjpc9\" (UniqueName: \"kubernetes.io/projected/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-kube-api-access-bjpc9\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.471738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.471652    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-metrics-certs\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.471738 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.471724    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-maas-api-tls\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.573049 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.573022    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-openshift-service-ca\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.573486 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.573055    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjpc9\" (UniqueName: \"kubernetes.io/projected/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-kube-api-access-bjpc9\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.573486 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.573098    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-metrics-certs\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.573486 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.573124    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-maas-api-tls\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.573981 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.573781    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-openshift-service-ca\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.575787 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.575585    4418 generic.go:356] "Generic (PLEG): container finished" podID="27553feb-e9c9-4527-8ad3-ee4229ee14ad" containerID="6bd82664c2a3b597f9c33837265279bdbb1c11e287030eaa7b2198f65dd2f32a" exitCode=0
Nov 03 06:24:50.575787 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.575685    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x" event={"ID":"27553feb-e9c9-4527-8ad3-ee4229ee14ad","Type":"ContainerDied","Data":"6bd82664c2a3b597f9c33837265279bdbb1c11e287030eaa7b2198f65dd2f32a"}
Nov 03 06:24:50.575973 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.575830    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-metrics-certs\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.576078 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.576054    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-maas-api-tls\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.599127 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.599102    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjpc9\" (UniqueName: \"kubernetes.io/projected/e0bf7334-7ce9-402f-91cc-6a39ed84e4d3-kube-api-access-bjpc9\") pod \"maas-api-687bf79496-gcks8\" (UID: \"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3\") " pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:50.637882 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.637862    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:50.673720 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.673656    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-metrics-certs\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-metrics-certs\") pod \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") "
Nov 03 06:24:50.673720 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.673707    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-maas-api-tls\") pod \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") "
Nov 03 06:24:50.673902 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.673748    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27553feb-e9c9-4527-8ad3-ee4229ee14ad-kube-api-access-xkdxc\" (UniqueName: \"kubernetes.io/projected/27553feb-e9c9-4527-8ad3-ee4229ee14ad-kube-api-access-xkdxc\") pod \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") "
Nov 03 06:24:50.673902 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.673830    4418 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27553feb-e9c9-4527-8ad3-ee4229ee14ad-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27553feb-e9c9-4527-8ad3-ee4229ee14ad-openshift-service-ca\") pod \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\" (UID: \"27553feb-e9c9-4527-8ad3-ee4229ee14ad\") "
Nov 03 06:24:50.674258 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.674235    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27553feb-e9c9-4527-8ad3-ee4229ee14ad-openshift-service-ca" pod "27553feb-e9c9-4527-8ad3-ee4229ee14ad" (UID: "27553feb-e9c9-4527-8ad3-ee4229ee14ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 06:24:50.675730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.675708    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-maas-api-tls" pod "27553feb-e9c9-4527-8ad3-ee4229ee14ad" (UID: "27553feb-e9c9-4527-8ad3-ee4229ee14ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:24:50.675810 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.675725    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-metrics-certs" pod "27553feb-e9c9-4527-8ad3-ee4229ee14ad" (UID: "27553feb-e9c9-4527-8ad3-ee4229ee14ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 06:24:50.675810 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.675726    4418 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27553feb-e9c9-4527-8ad3-ee4229ee14ad-kube-api-access-xkdxc" pod "27553feb-e9c9-4527-8ad3-ee4229ee14ad" (UID: "27553feb-e9c9-4527-8ad3-ee4229ee14ad"). InnerVolumeSpecName "kube-api-access-xkdxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 06:24:50.774900 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.774871    4418 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27553feb-e9c9-4527-8ad3-ee4229ee14ad-openshift-service-ca\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:24:50.774900 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.774898    4418 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-metrics-certs\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:24:50.775095 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.774908    4418 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27553feb-e9c9-4527-8ad3-ee4229ee14ad-maas-api-tls\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:24:50.775095 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.774919    4418 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkdxc\" (UniqueName: \"kubernetes.io/projected/27553feb-e9c9-4527-8ad3-ee4229ee14ad-kube-api-access-xkdxc\") on node \"ip-10-0-138-242.ec2.internal\" DevicePath \"\""
Nov 03 06:24:50.780298 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:50.780268    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:51.081048 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.081017    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-687bf79496-gcks8"]
Nov 03 06:24:51.083076 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:24:51.083050    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bf7334_7ce9_402f_91cc_6a39ed84e4d3.slice/crio-2e294c2f80a3d1d9626c187a8a2b823a377e24cf807fd57e7beff68e32509537 WatchSource:0}: Error finding container 2e294c2f80a3d1d9626c187a8a2b823a377e24cf807fd57e7beff68e32509537: Status 404 returned error can't find the container with id 2e294c2f80a3d1d9626c187a8a2b823a377e24cf807fd57e7beff68e32509537
Nov 03 06:24:51.582030 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.581991    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8" event={"ID":"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3","Type":"ContainerStarted","Data":"055dbde1dee8d33e506df51cb7838e58ee4fe11c91bdf66da4047cc19dca45dd"}
Nov 03 06:24:51.582455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.582162    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:51.582455 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.582199    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8" event={"ID":"e0bf7334-7ce9-402f-91cc-6a39ed84e4d3","Type":"ContainerStarted","Data":"2e294c2f80a3d1d9626c187a8a2b823a377e24cf807fd57e7beff68e32509537"}
Nov 03 06:24:51.583189 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.583165    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x" event={"ID":"27553feb-e9c9-4527-8ad3-ee4229ee14ad","Type":"ContainerDied","Data":"2a9fb951eb67cec50b0e95c4092f7a699df3550cc886817bef47b6df7bf24cdb"}
Nov 03 06:24:51.583189 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.583184    4418 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"
Nov 03 06:24:51.583340 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.583206    4418 scope.go:122] "RemoveContainer" containerID="6bd82664c2a3b597f9c33837265279bdbb1c11e287030eaa7b2198f65dd2f32a"
Nov 03 06:24:51.623619 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.623570    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8" podStartSLOduration=1.318794744 podStartE2EDuration="1.623556895s" totalImagesPullingTime="304.762151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 06:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:24:51.62297276 +0000 UTC m=+1778.992922846" watchObservedRunningTime="2026-11-03 06:24:51.623556895 +0000 UTC m=+1778.993506979"
Nov 03 06:24:51.658588 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.658520    4418 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"]
Nov 03 06:24:51.666789 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:51.666766    4418 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6fd5d8948d-rm52x"]
Nov 03 06:24:52.447165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:52.447131    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:52.627464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:52.627421    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:52.782092 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:52.782014    4418 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27553feb-e9c9-4527-8ad3-ee4229ee14ad" path="/var/lib/kubelet/pods/27553feb-e9c9-4527-8ad3-ee4229ee14ad/volumes"
Nov 03 06:24:54.088196 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:54.088157    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:54.320611 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:54.320575    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:55.939768 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:55.939734    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:56.982368 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:56.982340    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:57.548033 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:57.548004    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:24:57.596404 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:57.596374    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-687bf79496-gcks8"
Nov 03 06:24:58.403876 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:24:58.403837    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:24:59.254316 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:24:59.254284    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:00.837031 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:00.836998    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:02.432696 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:02.432655    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:04.224894 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:04.224859    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:05.911091 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:05.911057    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:06.826412 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:06.826382    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:07.651079 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:07.651041    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:09.579166 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:09.579134    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:11.341131 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:11.341096    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:13.041352 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:13.041320    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:14.752613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:14.752575    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:16.536188 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:16.536132    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:18.357219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:18.357180    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:18.939628 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:18.939595    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:19.117112 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:19.117079    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:20.061165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:20.061123    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:21.608958 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:21.608923    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:22.113440 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:22.113404    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:22.282107 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:22.282080    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:24.710660 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:24.710628    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:25.947429 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:25.947399    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:26.443657 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:26.443620    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:26.611123 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:26.611093    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:28.405755 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:25:28.405717    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:25:30.097561 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:30.097528    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:30.261747 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:30.261713    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:31.726410 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:31.726372    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:31.926344 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:31.926310    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:32.108998 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:32.108913    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:33.657227 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:33.657185    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:35.453155 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:35.453120    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:37.339995 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:37.339962    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:39.085733 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:39.085704    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:40.930803 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:40.930768    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:42.934454 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:42.934416    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:44.754236 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:44.754205    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:44.951183 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:44.951149    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:46.681437 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:46.681332    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:48.631706 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:48.631676    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:50.470347 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:50.470307    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:52.233559 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:52.233492    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:53.948908 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:53.948876    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:55.756464 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:55.756263    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:57.443147 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:57.443113    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:25:58.404609 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:25:58.404568    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:25:59.159871 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:25:59.159839    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:00.848023 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:00.847985    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:02.549862 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:02.549831    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:04.248891 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:04.248852    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:06.015453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:06.015368    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:06.950004 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:06.949972    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:07.662055 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:07.662009    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:09.350596 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:09.350558    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:11.060214 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:11.060180    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:12.837286 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:12.837247    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:14.656971 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:14.656938    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:16.340867 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:16.340825    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:18.040801 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:18.040747    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:19.786790 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:19.786757    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:21.529329 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:21.529291    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:23.242489 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:23.242449    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:25.053238 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:25.053207    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:26.752787 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:26.752752    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:28.405254 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:26:28.405221    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:26:28.443616 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:28.443584    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:30.264676 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:30.264644    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:32.124292 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:32.124254    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:33.751143 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:33.751109    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:35.558245 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:35.558213    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:37.244888 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:37.244857    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:39.042067 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:39.042031    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:40.745912 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:40.745875    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:42.480672 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:42.480636    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:44.155873 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:44.155835    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:45.953217 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:45.953184    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:47.642165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:47.642125    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:49.367681 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:49.367639    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:51.048292 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:51.048256    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:52.838214 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:52.838176    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:54.547669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:54.547638    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:56.342723 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:56.342685    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:58.085898 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:58.085872    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:26:58.404241 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:26:58.404201    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:26:59.755232 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:26:59.755192    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:01.455453 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:01.455415    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:03.248557 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:03.248487    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:04.971297 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:04.971261    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:06.779997 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:06.779961    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:07.056721 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:07.056643    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:08.450381 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:08.450313    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:10.284529 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:10.284487    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:11.939879 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:11.939838    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:13.640928 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:13.640888    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:15.354072 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:15.353991    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:15.518807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:15.518779    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:15.683740 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:15.683706    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:22.092223 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:22.092182    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:22.613327 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:22.613296    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:22.773938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:22.773901    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:23.313794 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:23.313754    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:28.404342 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:27:28.404254    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:27:29.570057 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:29.570021    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:29.747807 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:29.747769    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:29.915613 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:29.915581    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:40.399842 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:27:40.399805    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:27:58.403949 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:27:58.403910    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:28:01.313989 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:01.313952    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:28:01.478560 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:01.478521    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:28:07.174407 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:07.174373    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:28:07.337647 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:07.337614    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:28:26.937682 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:26.937650    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7796c97cc5-7sf6p_a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac/authorino/0.log"
Nov 03 06:28:28.460107 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:28:28.460067    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:28:37.703968 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:37.703935    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-bm44l_9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad/manager/0.log"
Nov 03 06:28:37.897190 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:37.897161    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-ntcx4_4111e193-18f7-46fb-a769-a516c78c2e13/manager/0.log"
Nov 03 06:28:38.097358 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:38.097281    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pkcvl_c8496696-0e28-4642-adda-3cff900078d8/manager/0.log"
Nov 03 06:28:38.699889 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:38.699865    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-9q8nl_f10a3705-099d-4d82-85e1-02bcb560362d/server/0.log"
Nov 03 06:28:38.891548 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:38.891512    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-kcp47_f900f26a-d724-41b4-b960-23ec731ac960/manager/0.log"
Nov 03 06:28:39.830564 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:39.830537    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-687bf79496-gcks8_e0bf7334-7ce9-402f-91cc-6a39ed84e4d3/maas-api/0.log"
Nov 03 06:28:41.285864 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:41.285835    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-wmss9_379e1141-2b44-4a16-b609-538afd96059d/postgres/0.log"
Nov 03 06:28:42.754917 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:42.754887    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7796c97cc5-7sf6p_a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac/authorino/0.log"
Nov 03 06:28:43.989043 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:43.989012    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-h7j92_27c75630-5e15-45f9-8f58-5031840eac08/manager/0.log"
Nov 03 06:28:45.317676 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:45.317646    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d95cd9746-vxcv5_bbb40a89-211d-4d94-a4ca-ca1b7ebc1841/kube-auth-proxy/0.log"
Nov 03 06:28:45.499274 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:45.499245    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-27zsf_cf338851-2cf1-467e-9683-c5e6bfd65843/istio-proxy/0.log"
Nov 03 06:28:45.874853 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:45.874824    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-bgxkm_60dd6d76-b7cd-40ed-aa14-e5c637969321/istio-proxy/0.log"
Nov 03 06:28:46.283093 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:46.283006    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-ngjk2_ef10258e-5fcc-4d6c-ba91-f31997a227ae/istio-proxy/0.log"
Nov 03 06:28:51.158451 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:51.158414    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:28:51.170899 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:28:51.170875    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7796c97cc5-7sf6p_a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac/authorino/0.log"
Nov 03 06:28:58.404150 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:28:58.404068    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:29:00.329395 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:00.329368    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-bm44l_9b80aa7f-711a-4414-bfd4-0a5bbbdf4dad/manager/0.log"
Nov 03 06:29:00.572977 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:00.572924    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-ntcx4_4111e193-18f7-46fb-a769-a516c78c2e13/manager/0.log"
Nov 03 06:29:00.828856 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:00.828824    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pkcvl_c8496696-0e28-4642-adda-3cff900078d8/manager/0.log"
Nov 03 06:29:01.302140 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:01.302112    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-9q8nl_f10a3705-099d-4d82-85e1-02bcb560362d/server/0.log"
Nov 03 06:29:01.494740 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:01.494703    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-kcp47_f900f26a-d724-41b4-b960-23ec731ac960/manager/0.log"
Nov 03 06:29:02.343737 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:02.343706    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-687bf79496-gcks8_e0bf7334-7ce9-402f-91cc-6a39ed84e4d3/maas-api/0.log"
Nov 03 06:29:03.681791 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:03.681757    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-wmss9_379e1141-2b44-4a16-b609-538afd96059d/postgres/0.log"
Nov 03 06:29:04.822639 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:04.822610    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7796c97cc5-7sf6p_a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac/authorino/0.log"
Nov 03 06:29:06.070119 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:06.070088    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-h7j92_27c75630-5e15-45f9-8f58-5031840eac08/manager/0.log"
Nov 03 06:29:07.275159 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:07.275127    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d95cd9746-vxcv5_bbb40a89-211d-4d94-a4ca-ca1b7ebc1841/kube-auth-proxy/0.log"
Nov 03 06:29:07.309230 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:07.309202    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:29:07.458142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:07.458109    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-27zsf_cf338851-2cf1-467e-9683-c5e6bfd65843/istio-proxy/0.log"
Nov 03 06:29:07.862142 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:07.862110    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-bgxkm_60dd6d76-b7cd-40ed-aa14-e5c637969321/istio-proxy/0.log"
Nov 03 06:29:08.275950 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:08.275915    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-ngjk2_ef10258e-5fcc-4d6c-ba91-f31997a227ae/istio-proxy/0.log"
Nov 03 06:29:28.404668 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:29:28.404632    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:29:32.616385 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:32.616350    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:29:32.785278 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:29:32.785199    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:29:58.402965 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:29:58.402928    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:30:07.437714 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:07.437682    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:30:28.404010 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:30:28.403927    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:30:37.179048 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:37.179008    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:30:37.347154 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:37.347119    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:30:41.438371 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:41.438341    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t477r_44da4b70-4f4c-4cdf-8be7-684f68743c76/global-pull-secret-syncer/0.log"
Nov 03 06:30:42.147176 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:42.147145    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log"
Nov 03 06:30:42.658343 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:42.658307    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-242.ec2.internal_64792e0a2fa5247cd6cb1dcb331e5e11/haproxy/0.log"
Nov 03 06:30:43.609555 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:43.609493    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:30:43.809984 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:43.809949    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:30:48.974642 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:48.974604    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7796c97cc5-7sf6p_a4e8afb7-0ef9-4e43-a0be-d4f9494de4ac/authorino/0.log"
Nov 03 06:30:49.747993 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:49.747954    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-h7j92_27c75630-5e15-45f9-8f58-5031840eac08/manager/0.log"
Nov 03 06:30:51.136219 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.136187    4418 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"]
Nov 03 06:30:51.136712 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.136696    4418 cpu_manager.go:414] "containerMap: removing container" podUID="27553feb-e9c9-4527-8ad3-ee4229ee14ad" containerName="maas-api"
Nov 03 06:30:51.136759 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.136714    4418 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27553feb-e9c9-4527-8ad3-ee4229ee14ad" containerName="maas-api"
Nov 03 06:30:51.136811 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.136802    4418 memory_manager.go:365] "RemoveStaleState removing state" podUID="27553feb-e9c9-4527-8ad3-ee4229ee14ad" containerName="maas-api"
Nov 03 06:30:51.139905 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.139886    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.156264 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.156245    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9b79\"/\"openshift-service-ca.crt\""
Nov 03 06:30:51.168106 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.168085    4418 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9b79\"/\"kube-root-ca.crt\""
Nov 03 06:30:51.168482 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.168459    4418 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c9b79\"/\"default-dockercfg-b9xm5\""
Nov 03 06:30:51.170236 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.170213    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"]
Nov 03 06:30:51.267778 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.267751    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-lib-modules\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.267920 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.267782    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-proc\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.267920 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.267910    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-podres\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.268006 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.267947    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-sys\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.268006 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.267964    4418 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxml5\" (UniqueName: \"kubernetes.io/projected/c27440ec-def9-4081-90ac-4ffb44670108-kube-api-access-cxml5\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369259 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369225    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-podres\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369267    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-sys\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369283    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxml5\" (UniqueName: \"kubernetes.io/projected/c27440ec-def9-4081-90ac-4ffb44670108-kube-api-access-cxml5\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369335    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-lib-modules\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369349    4418 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-proc\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369347    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-podres\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369347    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-sys\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369423 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369405    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-proc\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.369708 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.369447    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c27440ec-def9-4081-90ac-4ffb44670108-lib-modules\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.391973 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.391914    4418 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxml5\" (UniqueName: \"kubernetes.io/projected/c27440ec-def9-4081-90ac-4ffb44670108-kube-api-access-cxml5\") pod \"perf-node-gather-daemonset-2fb4q\" (UID: \"c27440ec-def9-4081-90ac-4ffb44670108\") " pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.452254 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.452231    4418 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:51.752745 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:51.752714    4418 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"]
Nov 03 06:30:51.755557 ip-10-0-138-242 kubenswrapper[4418]: W1103 06:30:51.755529    4418 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc27440ec_def9_4081_90ac_4ffb44670108.slice/crio-1a79018a8d74fdbe3b9c42121ed67a9b2e5b3876ec39a36f53ee0d6b1f730893 WatchSource:0}: Error finding container 1a79018a8d74fdbe3b9c42121ed67a9b2e5b3876ec39a36f53ee0d6b1f730893: Status 404 returned error can't find the container with id 1a79018a8d74fdbe3b9c42121ed67a9b2e5b3876ec39a36f53ee0d6b1f730893
Nov 03 06:30:52.291157 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:52.291122    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q" event={"ID":"c27440ec-def9-4081-90ac-4ffb44670108","Type":"ContainerStarted","Data":"8693b8242486baefaa5d211aad2c2a91a0381da4211946dec33a7d5e3961328f"}
Nov 03 06:30:52.291618 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:52.291199    4418 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q" event={"ID":"c27440ec-def9-4081-90ac-4ffb44670108","Type":"ContainerStarted","Data":"1a79018a8d74fdbe3b9c42121ed67a9b2e5b3876ec39a36f53ee0d6b1f730893"}
Nov 03 06:30:52.291618 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:52.291223    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:52.319362 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:52.319338    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79bf56848b-hz9r2_230a6e7c-e739-4159-8ece-4b822c5edf2a/metrics-server/0.log"
Nov 03 06:30:52.330473 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:52.330425    4418 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q" podStartSLOduration=1.330411739 podStartE2EDuration="1.330411739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 06:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 06:30:52.330244897 +0000 UTC m=+2139.700194980" watchObservedRunningTime="2026-11-03 06:30:52.330411739 +0000 UTC m=+2139.700361824"
Nov 03 06:30:52.432669 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:52.432629    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-jl2hw_131f2b49-2945-4a74-8865-3fa39d5c196c/monitoring-plugin/0.log"
Nov 03 06:30:52.900157 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:52.900111    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwt9w_c8bc82ad-78ff-47bd-99d0-862cc9f393c9/node-exporter/0.log"
Nov 03 06:30:53.007805 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:53.007769    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwt9w_c8bc82ad-78ff-47bd-99d0-862cc9f393c9/kube-rbac-proxy/0.log"
Nov 03 06:30:53.117305 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:53.117280    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cwt9w_c8bc82ad-78ff-47bd-99d0-862cc9f393c9/init-textfile/0.log"
Nov 03 06:30:53.885859 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:53.885828    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47359278-ce5c-41b9-a405-6fb4dd957b08/prometheus/0.log"
Nov 03 06:30:53.992550 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:53.992512    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47359278-ce5c-41b9-a405-6fb4dd957b08/config-reloader/0.log"
Nov 03 06:30:54.102165 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.102141    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47359278-ce5c-41b9-a405-6fb4dd957b08/thanos-sidecar/0.log"
Nov 03 06:30:54.209853 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.209773    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47359278-ce5c-41b9-a405-6fb4dd957b08/kube-rbac-proxy-web/0.log"
Nov 03 06:30:54.323021 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.322996    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47359278-ce5c-41b9-a405-6fb4dd957b08/kube-rbac-proxy/0.log"
Nov 03 06:30:54.431005 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.430975    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47359278-ce5c-41b9-a405-6fb4dd957b08/kube-rbac-proxy-thanos/0.log"
Nov 03 06:30:54.542836 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.542748    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47359278-ce5c-41b9-a405-6fb4dd957b08/init-config-reloader/0.log"
Nov 03 06:30:54.660183 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.660140    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-7jqcf_532477c3-7a46-4cf5-9020-66c87d467ec3/prometheus-operator/0.log"
Nov 03 06:30:54.764551 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.764518    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-7jqcf_532477c3-7a46-4cf5-9020-66c87d467ec3/kube-rbac-proxy/0.log"
Nov 03 06:30:54.876643 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:54.876594    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-wstbd_57b5cfa3-0cc5-40f9-b04a-32c865d60876/prometheus-operator-admission-webhook/0.log"
Nov 03 06:30:55.327674 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:55.327591    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc5bcb78b-rhz4c_a929c08f-96a7-49cf-8e76-9d9ac6389c10/thanos-query/0.log"
Nov 03 06:30:55.440817 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:55.440786    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc5bcb78b-rhz4c_a929c08f-96a7-49cf-8e76-9d9ac6389c10/kube-rbac-proxy-web/0.log"
Nov 03 06:30:55.550139 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:55.550084    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc5bcb78b-rhz4c_a929c08f-96a7-49cf-8e76-9d9ac6389c10/kube-rbac-proxy/0.log"
Nov 03 06:30:55.660927 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:55.660898    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc5bcb78b-rhz4c_a929c08f-96a7-49cf-8e76-9d9ac6389c10/prom-label-proxy/0.log"
Nov 03 06:30:55.769866 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:55.769840    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc5bcb78b-rhz4c_a929c08f-96a7-49cf-8e76-9d9ac6389c10/kube-rbac-proxy-rules/0.log"
Nov 03 06:30:55.879483 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:55.879459    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc5bcb78b-rhz4c_a929c08f-96a7-49cf-8e76-9d9ac6389c10/kube-rbac-proxy-metrics/0.log"
Nov 03 06:30:58.307093 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:58.307068    4418 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c9b79/perf-node-gather-daemonset-2fb4q"
Nov 03 06:30:58.403622 ip-10-0-138-242 kubenswrapper[4418]: E1103 06:30:58.403590    4418 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dwm99" containerName="extractor"
Nov 03 06:30:59.387700 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:30:59.387671    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-phkl4_246d313e-4827-406e-9fba-127271c2254c/download-server/0.log"
Nov 03 06:31:02.937675 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:02.937648    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7zjvt_7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4/dns/0.log"
Nov 03 06:31:03.047891 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:03.047865    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7zjvt_7d213c9f-f744-4f2f-a7f8-8cddb5abb8e4/kube-rbac-proxy/0.log"
Nov 03 06:31:03.750258 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:03.750228    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hjb7w_7c1a66d3-b7e0-4e4d-beb0-f64d3212543a/dns-node-resolver/0.log"
Nov 03 06:31:05.383732 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:05.383703    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d95cd9746-vxcv5_bbb40a89-211d-4d94-a4ca-ca1b7ebc1841/kube-auth-proxy/0.log"
Nov 03 06:31:05.400246 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:05.400206    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zn76c_180ebbd8-f149-4418-b609-572389c6d617/node-ca/0.log"
Nov 03 06:31:05.447488 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:05.447453    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-27zsf_cf338851-2cf1-467e-9683-c5e6bfd65843/istio-proxy/0.log"
Nov 03 06:31:05.576728 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:05.576703    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-bgxkm_60dd6d76-b7cd-40ed-aa14-e5c637969321/istio-proxy/0.log"
Nov 03 06:31:05.673069 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:05.672995    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-ngjk2_ef10258e-5fcc-4d6c-ba91-f31997a227ae/istio-proxy/0.log"
Nov 03 06:31:07.583978 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:07.583949    4418 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hcd9r_a25e9f30-3ae1-4319-a77a-708295d60f0f/konnectivity-agent/0.log" limit=1024
Nov 03 06:31:08.480113 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:08.480087    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d95cd9746-vxcv5_bbb40a89-211d-4d94-a4ca-ca1b7ebc1841/kube-auth-proxy/0.log"
Nov 03 06:31:08.597011 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:08.596975    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-27zsf_cf338851-2cf1-467e-9683-c5e6bfd65843/istio-proxy/0.log"
Nov 03 06:31:08.823730 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:08.823646    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-bgxkm_60dd6d76-b7cd-40ed-aa14-e5c637969321/istio-proxy/0.log"
Nov 03 06:31:09.028938 ip-10-0-138-242 kubenswrapper[4418]: I1103 06:31:09.028906    4418 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-778b7b5c47-ngjk2_ef10258e-5fcc-4d6c-ba91-f31997a227ae/istio-proxy/0.log"